15% off membership for Easter! Learn more. Close

As the product manager responsible for Facebook's newsfeed, your task is to increase the number of posts users see per day. To test this, the company conducted an A/B test with a randomized 1% sample of the population. Which metrics would be affected by this change, and what type of data should you anticipate as a result?

Asked at Meta (facebook)
281 views
Answers (1)
To answer this question, Log in.
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Gold PM

CQ:

  1. What are we testing -> more posts from people and fewer ads

  2. Platform specific - web or app -> agnostic

  3. Any particular geography we are focussing on -> agnostic

  4. Any specific metric we are targeting to inc the no of posts -> lets say 5% in 1 month

 

Metrics for the A/B test:

  1. Avg session length for the control group vs test group

  2. Avg no of posts seen per session for the control group vs test group

  3. Measure reaction:

    1. Avg no of likes made in the test duration for the control group vs test group

    2. Avg no of comments made in the test duration for the control group vs test group

    3. Avg no of friends made in the test duration for the control group vs test group

 

Guard Rail Metrics:

 

  1. Impact on retention: % churn rate for the control group vs test group

  2. Revenue per 1000 impressions for the control group vs test group

Access expert answers by becoming a member
1 like   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs