15% off membership for Easter! Learn more. Close

How would you measure improvements made to Facebook messenger?

Asked at Meta (Facebook)
2.4k views
Answers (2)
check ribbonLiked by PM Exercises
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Platinum PM

A framework for approaching this metrics question in a Facebook PM interview:

Clarifying Questions

Is there any specific improvement that you have done to Facebook Messenger ?  its just a generic change and we can assume it will increase engagement

Have your A/B Tested it? Any specific metrics you have tracked? No,We have to start testing with a new set of metrics. 

 

Goal of Messenger 

The goal of messenger is to be go to platform for messaging for everyone. It allows users to connect with each other one on one or in a group conversations.  The whole motive behind any improvement is to increase these conversations thus increasing engagement or time spent on Messenger which is a Facebook property. 

 

User Journey

User comes to Facebook —> Sees his/her friends online —> starts a conversation —> the friends replies back and this continues till the end of the conversation --> may add more friends to the conversation and so on. 

Alternatively user comes to Facebook —> drops a message to a friend who is offline —> he/she comes online and responds to it and so on. 

 

Behaviours 

The two main behaviours I can think of are : Sending Messages and Reading Messages 

Secondary Behaviours would be starting a conversation, add more friends to the conversation or sending different types of messages to your friends such as text ,video, GIFs, Photos, Docs etc.

 

Metrics 

 

Number of messages sent per user per day 

New conversations started per user per day 

Distribution of types of messages sent by users

% of received messages responded to

% of sent messages read by receiver 

Time between messages sent and you reading it.  

Response time after reading a message

Average Time between messages in one on one conversations 

Active group conversations per user per day 

Time between messages in a group conversation

% Active participants in a group conversation

Time spent on Messenger conversing with people / User Stickiness

% of conversations where more people were added

 

Prioritising them based on impact to the goal

 

Number of messages sent per user per day 

New conversations started per user per day

% of received messages responded to

% of sent messages read by receiver 

Time spent on Messenger conversing with people / User stickiness

 

Access expert answers by becoming a member
4 likes   |  
1 Feedback
badge Platinum PM

Things you did well

  • Well structured : Great initial overview of how you plan to answer the question and great structure throughout the answer 
  • Product Description: You did a great job explaining what the product does and how it works today
  • Clarifying questions: You asked good clarifying questions to narrow down the scope of the question 
  • Overview of the user journey: You walked through the user journey and highlighted the relevant metrics for each phase of the user journey which was great
  • List of metrics: You came up with good list of metrics 
Great answer overall. Well done! 
0
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge Bronze PM

  1. Clarifying:
    1. Any specific improvement?
  2. User journey - Send and receive messages where both people could be online or one could be online and other offline. Use videos calls. Create rooms. Add in filters, gifs etc. Share docs, phots etc.
  3. Metrics:
    1. Adoption:
      1. Usage rate (whether people know about the product or not and whether we need to improve the awareness of the product): % of FB users who have used FB messenger at least once
        1. Build funnel metrics to understand the drop off like open the app, scroll through friend list, selecting a friend that opens a new chat window, sending a message.
      2. # of new conversations started/day/user
    2. Engagement:
      1. Avg time spent/user to understand the % of total FB time spent on messenger
        1. Cohort by light moderate high activity
      2. # of messages sent/user/day
      3. % of received messages responded to
    3. Retention
      1. % of repeat users within a certain time frame daily or weekly
      2. % of conversations continued from previous day

 

Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs