15% off membership for Easter! Learn more. Close

You're the PM for a new Meta product called Audio Rooms. What goals would you set for this product?

Asked at Meta (Facebook)
2.1k views
Answers (3)
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Platinum PM

Understanding the problem

First off, let's briefly establish a common definition of what Audio Rooms is and how users use it. Audio Rooms is a recently launched Facebook mobile app specific feature where users can find and join live audio rooms hosted by certain groups and public figures. The hosts control who can speak in the audio room. The audience members can send reactions. Users are made aware of Audio Rooms through notifications and their feed. 

 

In order to properly set the stage for this question, it's important to examine Audio Rooms in the context of it's parent company Meta and it's mission. Meta's mission statement is to bring the world closer together and give people the ability to build community. Audio Rooms directly supports this mission statement by letting public figures and leaders do live broadcasts to their follower communities. 

 

Metrics

It's worth noting that there are two distinct users here, the listeners and creators (audio room hosts). Both are important, our metrics and goals should encapsulate success for both of them.

There are a bunch of different metrics we could use to track how users are interacting with Audio Rooms, in order to stay organized and provide structure I like to group metrics by the different steps in the user lifecycle. 

Awareness 

  • Listeners: # of listeners who have seen an audio room notification or post in their feed, # of 
  • Creators: I'm not sure how creators are made aware of the ability to make an audio room, maybe we measure something like the number of opens on the newsletter announcing it or look at product update notification views

Activation

  • Listeners: # of listeners who have joined an audio room at least once
  • Creators: # of creators who have created an audio room

Engagement

  • Listeners: # of listeners who have spent at least 30+ minutes in an audio room / week, Average time spent in audio rooms per listener,  # of listeners who have joined 2+ different audio rooms / week, average number of users in an audio room, average number of reactions per user in an audio room
  • Creators: # of creators who have created 2+ audio rooms / month,  average audio room length, average # of audio rooms created per user / month

Retention

  • Listeners: % of listeners who spent at least 30 minutes in audio room last week who also spent 30 minutes in an audio room this week
  • Creators: % of creators who created 2+ audio rooms last month who also created 2+ audio rooms this month

Monetization

  • Listeners: # of ad impressions from audio room pages
  • Creators: average promotion revenue per audio room (assuming creators can pay to promote their audi rooms in the newsfeed)

Referrals

  • Listeners: # of times listeners tagged other people in Audio Room posts, # of times audio room links were shared by listeners
  • Creators: This is really more of a niche scenario, maybe we could track the number of times the product update post announcing this creatoe feature was shared
 
Prioritization & Goals
All of our above metrics each have their own place, but are not equally important. What is important and worth focusing on is dictated by where our product is at maturity wise. Due to my unfamiliarity with Audio Rooms, I'm going to assume that this is a newer or recently launched product.
 
The goal of a recently launched product should be establishing that we have correct product-market fit, after that we can worry about scaling and growing it to more users after we know we are providing value to users.
 
The best measure for product-market fit is engagement, if the product is adding value to users they will use it more and more. For that reason I suggest we focus on monitoring the average time spent in audio rooms per listener / week, and the average number of audio rooms created per creator / month
 
It is worth noting that we do need a small number of users already on our product to measure our engagement with, so for that reason I suggest we monitor awareness and activation as secondary goals. 
 
Downsides
I'm confident in our chosen metrics above, but with that said no metric or set of metrics is perfect. It is worth spending a few minutes discussing the downsides or potential gaps.
 
Our chosen metrics are very high level and don't offer us a lot of granularity or insight into the details. We don't know what types of audio rooms are performing well. For example, maybe celebrity shows are doing really well but political talks fair terribly? Additionally, we don't have much insight into how users are engaging while listening. Are they hitting play then zoning out or are they actively reacting to the content in real time?
 
We would also want to make sure we aren't having a negative impact on other parts of the product. Engagement with Audio Rooms could be taking users away from more high value actions like creating posts, uploading photos, and interacting with other users.
 
Summary
In order to prove product-market fit for the recently launched FB Audio Rooms we are going to focus on engagement as our primary goal by monitoring average time spent in audio rooms per listener / week, and the average number of audio rooms created per creator / month. 
Access expert answers by becoming a member
3 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge Gold PM
You're the PM for a new Meta product called Audio Rooms. What goals would you set for this product?
 
Understanding the product:
- enhance audio experience on FB.
- Live Audio Rooms to public figures, creators, and groups globally
- providing creators and communities more tools to connect, help people discover new voices they haven't heard before, and exchange ideas
- in response to rising interest in Clubhouse — will allow users to host live audio discussions on the platform
-  The number of speakers is limited to 50, and there's no limit to the number of listeners.
 
FB goal: to bring community closer
Audio room goal - help people discover new voices and exchange ideas within the commnity
Also it ties with Meta value proposition which is Tech and user graph, both of which are powerful to make Audio r
 
Actions:  There are 2 types of users:
 
Host:
- Create a Audio room -  determine start and end time
- Make the event private or public by sharing the link
- Invite the presenters
- enable live captions, chat box etc to interact with users.
 
Users can take:
- tap live captions
- provide live reactions
- join conversation
- invite other listeners and presenters
 
Funnel:
Host create a room (Audio/Video) -  determine start time (now or future)
Invite friends and presenters (Allow private or allow anyone who joins using link)
friends join through link or newsfeed
users enable live caption
users converse within rooms and react through messages
users purchase stars and send stars
Host end Audio room
 
Metrics:
 - Monetization doesnt seem to be a good metric as it may derail from overall mission of bringing community closer.
 
Engagement seems to be a good fit with overall mission of FB audio rooms.
 
 - its not a good idea to look at daily volume of Audio rooms or even monthly volume which may be too late, so looking at weekly audio rooms.
 
Host:
1) Number of Audio rooms created per Week.
2) Number of Audio rooms created per Host per week
3) Number of distinct hosts creating Audio rooms created per week - to understand the breadth/ reach of audio rooms among different communities and segments - This wil be my north-star as well.
4) Number of repeat hosts creating audio rooms per week - to understand retention.
 
Users:
1) Number of listeners per week
2) Number of listeners per audio rooms per week
3) Number of distinct listener per audio rooms - same thing as Host to understand the breadth of audio rooms among different listeners.
4) total time spent on audio rooms/ total time spent on FB
5) number of repeat listeners per week.
 
 
Counter-metrics:
distinct Hosts provide me the breadth but doesnt provide the volume of audio rooms created so my counter metric will be number of audio rooms created per week.
 
 
 
Access expert answers by becoming a member
1 like   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge Silver PM

My framework for answering this Facebook PM interview metrics question.

FB’s mission: To give people the power to build community and bring the world closer together.

Describe FB audio rooms:

  • creators can create a live audio room where they can have real-time conversations with their peers and fans, without the pressure of being on camera.
  • Only hosts can create a live audio room.

FB audio rooms’ goal:

  • Provide users with a social audio platform to engage with others in the community and facilitate meaningful conversations.

Business benefits:

  • engagement & retention: give people more value they can use FB for and increase the stickiness of FB
  • monetization: FB takes a cut from FB Stars

Users groups:

  • Hosts
    • public figures
    • creators
  • Speakers
  • Listeners

User actions:

Before the audio room begins

  • Hosts
    • create/schedule a live audio room
    • invite speakers to your room
    • publicize the event to their followers
  • speakers
    • publicize the event to their followers
  • listeners
    • RSVP to event

When the live audio room is in progress

  • hosts
    • keep live audio room for a decent amount of time to provide more chances for meaningful conversations to take place
    • moderate the live audio room
    • invite listeners to be speakers
    • end audio room
  • speakers
    • participate in the discussions
  • listeners
    • listen to the discussions
    • react to discussion through comments, reactions
    • purchase “stars”
    • send “stars”
    • make donations
    • request to be speakers

Metrics:

  • The average duration of the live audio room
    • this is a guardrail to ensure conversations are meaningful, a live audio room that only lasts 5 min may not be meaningful to the creators/listeners
  • Engagement rate of the live audio room, weighted scoring based on
    • number of engaged speakers (e.g. joining, unmuting to speak, time spent)
    • number of engaged listeners (e.g. joining, reacting, commenting, requesting to be a speaker, tipping, donating, time spent)
    • duration
  • % of live audio rooms with a high engagement rate
    • I’d break down the engagement rate into buckets of High, Medium, Low.
    • Work with data science to determine a baseline of what represents a high engagement live audio room (e.g., at least 20 minutes of duration, 2 speakers, 10 listeners, etc.)
  • Creator conversion rate (number of users who create or schedule a live audio room/number of users click “Create live audio room”
    • This will help us determine any bumpy steps in the UX of creating a live audio room. Live audio rooms are essentially a 2-sided marketplace, and audio room creation is our Supply, so we have to maintain a healthy supply to keep the market going.
  • Number of hosts creating live audio rooms per month
    • If the conversion rate is one of your key metrics, it's important to balance that with overall volume as well to make sure you aren't missing the full picture

North star metric

For this, I would choose

% of live audio rooms with High Engagement Rate

 

Since not everyone is eligible to become a host, my primary concern is not the acquisition of hosts or the overall creation of live audio rooms. My primary concern is when a live audio room is in progress, how engaged are the speakers and listeners, how is it driving towards the overall business goal of providing a social audio platform for meaningful conversations.

Access expert answers by becoming a member
4 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs