15% off membership for Easter! Learn more. Close

As a Product Manager on Facebook Newsfeed, how would you decide whether to show an advertisement or the "People You May Know" widget?

Asked at Meta (Facebook)
6.6k views
Answers (3)
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Gold PM

Note of caution: I landed this answer in an anti-climactic state. It felt natural and it was a good opportunity to employ some A/B testing. But would love to get some perspective on it.

Starting with the Newsfeed product goals

  1. Update user on their friends & family activities and posts
  2. Show what is trending in their social & demographic circle - news or a topic
  3. Ability to show contextual ads that users may find helpful in enhancing their life

Based on the goals I have mentioned above let's do a cost-benefit analysis of the two features:

 

Business GoalAdvertisementPeople You May Know (PYMK)
User Engagement & Retention  Yes (Primary)
Monetization Yes (Primary) Yes (Secondary)

If we look at "PYMK" as a lagging indicator or opportunity of goal #3 mentioned above, (that is better, target ads for the user depending on what their demographics, social topics, preferences are) then it is a great long-term or fail-safe feature. 

Since I want to understand how showing ads may help or deter users, we can proceed with an A/B test hypothesis:

  1. Hypothesis: user's who are actively engaged and already have social interactions on a regular basis are good candidates for targetted ads.
    1. To evaluate this test, we will probably want to measure the CTR on ads by this segment of user & some health metrics for a given period that shows if the engagement goes up with the introduction of the ads.
    2. Tradeoff: my concern with the engaged set of users seeing ads every time they log in will be that this will create fatigue and their interaction levels may decline.
  2. Hypothesis: User's who are passively active on facebook (check their friends feeds but not post much/anything for long periods) may find an incentive in helpful targeted ads as an informative platform to find cool/new things as it relates to them.
    1. To evaluate this test, we will need to measure the CTR on ads by this segment of users, keeping in mind that these users are not daily or even weekly active user and so the metrics will need to gauge over a longer time period. 
    2. % of WAU for the segment above will also be a helpful indicator of the engagement going up or further down with this feature.
    3. Tradeoff: I feel the biggest trade-off here is the user churn. So this has to be a calculated step. But the reward is big too. If the feature is positioned to this segment correctly, it may enhance user engagement and may give them something more to come back to the FB newsfeed for.

Summary: to capture the analysis above, it may be best to run an A/B test on a segment of users to decide if the algorithmic change of showing ads vs. showing PYMK widget is the right fit. If we go by the model above it may be a great opportunity to engage a passive segment of users with the caveat that the ads are informational and useful to them in addition to just CTR.

 

Ideas to curb the negative impact of the feature deployment: One last thing to add here is a kind of snooze button or a thumbs down that tells us from those segments of the user if they would like to view ads or if the add was useful. This will help us refine the ad content engine.

 

I hope you find this solution helpful!

Access expert answers by becoming a member
5 likes   |  
1 Feedback
badge Platinum PM
What you did well

- Clear understanding of the goals vs. ads.

- Clear hypothesis.

- Customer segmentation.

I think this is a good answer. I would have pretty much employed the same method

Input for consideration

- I would have added what I would to with the measurement.

   - Run further A/B tests to determine the ratio of news items to (ads, PYMK) to complete the solution.
0
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge Platinum PM
Before answering this Facebook product design interview question let's understand the intent of Facebook Newsfeed. The newsfeed is the first page that user see after loging in into the account that shows a collection of posts that may interest the user. From the users perspective, she will want to know

1. activity on the posts she created

2. interesting updates from her friends - ranked in order of user proximity, trending posts, current affairs in social circles

3. Updates from grps\websites that she may follow

4. Potential contacts - ppl you know

5 Ads.

From: business standpoint: ads provides monetization, ppl you knw - helps activation and engagement

Given facebooks mission to build authentic communities the ppl you knw brings a better value than ads also provides for a better landscape for monetization, engadement, etc.

Some of the other considerations to factor in the algorith for page creation should be

1. User usage patterns: If the user doesnt logon freq and hasnt developed the stickiness, we should prioritize UUMK instead of Ads since that provides more value for the user to revisit the page

2 History ad freq: If a user logs in multiple times a day and have a pretty dense friends graph, we should prioritize ads

3. CTR and impressions: user personalized ads and events on these ads. Based on past behaviours, followed posts, demographics we can use AI to understand if the specific ad content is useful and relevant

4. Real time - Another dynamic variable is time of day and current events. For example, it might make sense to render ads for Personalized gifts around Mothers day or Valentines day, Ads during night time/liesure time browsing.

Given there are multiple variables that need to be considered by the algorithm to determine the content, I would design this to be a dynamic AI based rule engine optimized by different ranking and relevance engines. Also, the success of these decisions should be monitored by metrics. Another key metric we need to be mindful of, while rendering ads is cannibalization. We dont want to adversely impact the users experience and move away from the core value proposition
Access expert answers by becoming a member
7 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

Aim: 

Using news feed's real estate to increase Click Through Rate of the widget by the user by showcasing relevant option between people you may know or Ads

Assumptions:

1. Suggestions for People you May Know are based on the following factors: 

  • Suggests people who work at the same place or are from the same university
  • Suggests people who are added in you cell phone contacts
  • Suggests people who have been tagged in pictures/posts together but aren't added as friends
  • Suggests people who have a higher number of people mutual friends
  • Suggests people who viewed your profile or someone who's profile you've viewed etc.

2. Suggestions for Advertisements based on the following factors:

  • User's Google/Amazon etc. search history
  • User's previously liked/interacted products
  • User's profile interests
  • User's age, location, gender and other demographics benchmarked against what people of similar demographics are buying

Factors I would base my decision on:

1. Relevance Percentage: To measure the relevance on a percent basis:

% Relevance = ( Total factors satisfied / Total Factors Existing ) 

Where the factors would be listed from assumptions. In terms of a tie in relevance, priority could be given to Ads to meet business goals.

Further, the one with higher relevance between people you may know and ads should be shown to the user to get higher CTR.

2. Users' Engagement trends: To see with user's prior activity on which they are more likely to engage with and decide on that basis. 

 

 

Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

Top Product Design interview questions