As a Product Manager on Facebook Newsfeed, how would you decide whether to show an advertisement or the "People You May Know" widget?
You'll get access to over 3,000 product manager interview questions and answers
Recommended by over 100k members
Note of caution: I landed this answer in an anti-climactic state. It felt natural and it was a good opportunity to employ some A/B testing. But would love to get some perspective on it.
Starting with the Newsfeed product goals:
- Update user on their friends & family activities and posts
- Show what is trending in their social & demographic circle - news or a topic
- Ability to show contextual ads that users may find helpful in enhancing their life
Based on the goals I have mentioned above let's do a cost-benefit analysis of the two features:
Business Goal | Advertisement | People You May Know (PYMK) |
User Engagement & Retention | Yes (Primary) | |
Monetization | Yes (Primary) | Yes (Secondary) |
If we look at "PYMK" as a lagging indicator or opportunity of goal #3 mentioned above, (that is better, target ads for the user depending on what their demographics, social topics, preferences are) then it is a great long-term or fail-safe feature.
Since I want to understand how showing ads may help or deter users, we can proceed with an A/B test hypothesis:
- Hypothesis: user's who are actively engaged and already have social interactions on a regular basis are good candidates for targetted ads.
- To evaluate this test, we will probably want to measure the CTR on ads by this segment of user & some health metrics for a given period that shows if the engagement goes up with the introduction of the ads.
- Tradeoff: my concern with the engaged set of users seeing ads every time they log in will be that this will create fatigue and their interaction levels may decline.
- Hypothesis: User's who are passively active on facebook (check their friends feeds but not post much/anything for long periods) may find an incentive in helpful targeted ads as an informative platform to find cool/new things as it relates to them.
- To evaluate this test, we will need to measure the CTR on ads by this segment of users, keeping in mind that these users are not daily or even weekly active user and so the metrics will need to gauge over a longer time period.
- % of WAU for the segment above will also be a helpful indicator of the engagement going up or further down with this feature.
- Tradeoff: I feel the biggest trade-off here is the user churn. So this has to be a calculated step. But the reward is big too. If the feature is positioned to this segment correctly, it may enhance user engagement and may give them something more to come back to the FB newsfeed for.
Summary: to capture the analysis above, it may be best to run an A/B test on a segment of users to decide if the algorithmic change of showing ads vs. showing PYMK widget is the right fit. If we go by the model above it may be a great opportunity to engage a passive segment of users with the caveat that the ads are informational and useful to them in addition to just CTR.
Ideas to curb the negative impact of the feature deployment: One last thing to add here is a kind of snooze button or a thumbs down that tells us from those segments of the user if they would like to view ads or if the add was useful. This will help us refine the ad content engine.
I hope you find this solution helpful!
1. activity on the posts she created
2. interesting updates from her friends - ranked in order of user proximity, trending posts, current affairs in social circles
3. Updates from grps\websites that she may follow
4. Potential contacts - ppl you know
5 Ads.
From: business standpoint: ads provides monetization, ppl you knw - helps activation and engagement
Given facebooks mission to build authentic communities the ppl you knw brings a better value than ads also provides for a better landscape for monetization, engadement, etc.
Some of the other considerations to factor in the algorith for page creation should be
1. User usage patterns: If the user doesnt logon freq and hasnt developed the stickiness, we should prioritize UUMK instead of Ads since that provides more value for the user to revisit the page
2 History ad freq: If a user logs in multiple times a day and have a pretty dense friends graph, we should prioritize ads
3. CTR and impressions: user personalized ads and events on these ads. Based on past behaviours, followed posts, demographics we can use AI to understand if the specific ad content is useful and relevant
4. Real time - Another dynamic variable is time of day and current events. For example, it might make sense to render ads for Personalized gifts around Mothers day or Valentines day, Ads during night time/liesure time browsing.
Given there are multiple variables that need to be considered by the algorithm to determine the content, I would design this to be a dynamic AI based rule engine optimized by different ranking and relevance engines. Also, the success of these decisions should be monitored by metrics. Another key metric we need to be mindful of, while rendering ads is cannibalization. We dont want to adversely impact the users experience and move away from the core value proposition
Aim:
Using news feed's real estate to increase Click Through Rate of the widget by the user by showcasing relevant option between people you may know or Ads
Assumptions:
1. Suggestions for People you May Know are based on the following factors:
- Suggests people who work at the same place or are from the same university
- Suggests people who are added in you cell phone contacts
- Suggests people who have been tagged in pictures/posts together but aren't added as friends
- Suggests people who have a higher number of people mutual friends
- Suggests people who viewed your profile or someone who's profile you've viewed etc.
2. Suggestions for Advertisements based on the following factors:
- User's Google/Amazon etc. search history
- User's previously liked/interacted products
- User's profile interests
- User's age, location, gender and other demographics benchmarked against what people of similar demographics are buying
Factors I would base my decision on:
1. Relevance Percentage: To measure the relevance on a percent basis:
% Relevance = ( Total factors satisfied / Total Factors Existing )
Where the factors would be listed from assumptions. In terms of a tie in relevance, priority could be given to Ads to meet business goals.
Further, the one with higher relevance between people you may know and ads should be shown to the user to get higher CTR.
2. Users' Engagement trends: To see with user's prior activity on which they are more likely to engage with and decide on that basis.
Top Meta (Facebook) interview questions
- What is your favorite product? Why?89 answers | 263k views
- How would you design a bicycle renting app for tourists?62 answers | 82.5k views
- Build a product to buy and sell antiques.54 answers | 66.8k views
- See Meta (Facebook) PM Interview Questions
Top Product Design interview questions
- How would you design a web search engine for children below 14 years old?36 answers | 42.9k views
- Design a library for the future.25 answers | 23.5k views
- How would you design a consumer application for a scooter sharing business?21 answers | 18.6k views
- See Product Design PM Interview Questions
Top Product Design interview questions
- Build a product to solve the dog poop problem.13 answers | 9.4k views
- How would you design a "Google Refrigerator"?13 answers | 8.3k views
- Design a social travel product.12 answers | 13.4k views
- See Product Design PM Interview Questions