15% off membership for Easter! Learn more. Close

How would you enhance the Meta AI chatbot experience within Instagram direct messages?

Asked at Meta (facebook)
551 views
Answers (1)
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Gold PM

Step 1 - Briefly explain the product

I would like to start by describing my understanding of the AI chatbot that meta uses. This is the chatbot inside Instagram using which you can have a conversation with it. There are some helper ideas to get you started but you can have any free form conversation like with any other person. The bot is built on Llama, which is Meta's foundational AI model, and this model is available on other Meta apps as well, such as Whatsapp, Facebook and Messenger. 
 
Is my understanding correct, or is there anything else I need to know in the context of this question before I dig deeper. 
 
 
Interviewer - I think it's fine.
 
Step 2 - Narrow down the scope of the problem
I have a few questions I would like to ask before actually digging deeper into the problem. Why do we feel the need to enhance this chatbot? Are enough people not chatting with the bot? Are people dropping off after a few threads in the conversation? Or is it more strategic where we see the world moving towards agents and we want to do something in that space as well leveraging the bot?
Interviewer - It's a bit of all 3 actually.
 
Step 3 - Segment users and shortlist user groups
Currently the bot experience is part of Instagram, so I would like to segment the instagram users here. Can I take a minute to write down some thoughts before sharing them?
 
Interviewer - Sure.
 
In Instagram, we have the following broad user segments.
  1. Content Creators
  2. Content consumers (posters)
  3. Advertisers
 
I think it's important to note the flywheel that is crucial to Instagram's business model. So more consumers would mean more creators create content on Instagram, which would mean more revenue from advertising. 
 
If we look deeper into the content consumers, I would like to segment the users by the following.
  1. Power Users - Visit instagram daily and spend at least 30 mins to an hour on Instagram
  2. Casual Users - Visiti instagram, maybe once a week or so and spend around 15 mins and then leave. These don't visit very frequently.
  3. Non-users - Visit maybe once in a month or two and are not at all active.
 
I want to target the casual and non-users here, because making them visit more frequently will have a great impact on that fly wheel and that would result in gains for Instagram and Meta as a company
 
Step 4 - Identify and Prioritize pain points
Next, I would like to go over some of the pain points that the users of this segment and more generally, this generation faces. Can I take a couple of minutes to come up with that list?
 
User JourneyPain PointPriority
LoginOverwhelmed with too many things coming at you at the same timeL - This is a problem but the product is so mature that people are now used to this.
Scrolling through the platformSpend too much time doomscrollingM - This is a problem which hinders the app's growth amongst the new generation because some of them are terrified of getting addicted and it also leads to bad press. I am putting this as Medium because at an OS level (both Android and iOS) we can restrict the usage of apps based on the time. 
 I like a certain dress in a picture posted but I am not able to find that anywhereH - This is a great problem to solve from an engagement perspective as if I see some dress in a picture or some neat electronics item that is not sponsored, I would like to see where I could get that from
 I like something and a brand is selling on instagram but I do not know about it. For eg., there is a cold brew that some people speak highly about but I don't know about that brand.M - This is a problem again where users can know based on their preference if a new brand is coming up. I am not keeping this as high because brands do invest in Instagram on marketing so more often that not this will come up on the users' feed.
Talking to friendsSomething is bothering me so I just want to rant to someone but my friends are not online or its late at night and I don't want to disturb them.H - Mental health is an increasingly important trend and this is something that will be important to cater to
 Don't know who I reach out to for certain issues that I am facingH - Instagram actually has helpful videos such as how to open a car that gets locked with the keys inside, etc. So, showing these videos in context is actually quite helpful
 
So, based on the above, let's tackle these 3 challenges.
  1. I like a certain dress in a picture posted but I am not able to find that anywhere
  2. Something is bothering me so I just want to rant to someone but my friends are not online or its late at night and I don't want to disturb them.
  3. Don't know who I reach out to for certain issues that I am facing
 
If we look at these 3 cases, all these 3 cases are something that can be tackled with the help of an assistant. 
 
Step 5 - Brainstorm solutions and prioritize 
Let's look at an Instagram Assistant - Donna, that will help you solve these problems.
Pain PointSolutionImpact to GoalEffort
I like a certain dress in a picture posted but I am not able to find that anywhereLook up the various brands that have the same dress and show those dresses thereMedium - This will not impact the engagement metric as much and may also be seen as too in your face if not done rightLow - Should already be available
 Have an interaction between the assistant and the page, and load the instagram page with the details of the brands that are selling the same dress High - This will allow more people to interact with the assistant as well as lead to more engagementHigh - This will need an image recognition model that matches with the images in the DB and then fetch the results
Something is bothering me so I just want to rant to someone but my friends are not online or its late at night and I don't want to disturb them.Free form writing and just exchanging thoughts. Help them get better at a certain skillMedium - A lot of people struggle with skills such as writing and this could be used from within instagram. The assistant could just guide you with how to get better. I am putting this as medium because Instagram may not be the best platform for this.Low - The Llama model already would do this, so it should be doable
 Create a daily planner or a to do and check in with the user on the progress to make them more productiveHigh - The assistant could work with you to set up a daily planner and keep you honest. Every time the user comes, the assistant could check in with them on the progressMedium - We need to check in with the user every day to see how the progress is.
 Listen to the rant and try to advice and let them seek help if requiredLow - I understand mental health is important but this may not be the best place to do thatLow
Don't know who I reach out to for certain issues that I am facingGive them list of businesses to reach out to in case of any issue. For instance, I left the keys in the car, etc.Low - People would probably google themMedium - Needs to check the directory. Last I checked, Llama needs to get better at this
 If available, load some quick videos that they can try out so that these issues get resolved. For instance, how to change a flat tyre.High - This could be useful and improve the engagement on the appMedium - Load the correct video based on the request made.
Based on the above, I would prioritize the following.
  1. Create a daily planner or a to do and check in with the user on the progress to make them more productive
  2. If available, load some quick videos that they can try out so that these issues get resolved. For instance, how to change a flat tyre.
  3. Have an interaction between the assistant and the page, and load the instagram page with the details of the brands that are selling the same dress 
 
We can actually have an assistant like Donna (maybe even in the same tone as the character from Suits who can assist the user with various decisions)
 
The last one may be high effort but if we can nail it it would lead to increased engagement.
 
Step 7 - Metrics to be tracked
I would track the following metrics of the chat bot
  1. Avg. no. of interactions (1 bot interaction and 1 user response will be 1 interaction) per day
  2. Number of assistant sessions per day
  3. Number of sessions leading to an action (for eg. if we build point 3 above, how many of the sessions led to a purchase decision)
 
Step 8 - Summary
In summary, we were looking to enhance the Meta AI chatbot messages within the Instagram DMs. With that regard, we narrowed down to the casual and the non-users of Instagram and we wanted to make them use this to improve engagement. We listed a set of problem and came up with the following problems.
  1. I like a certain dress in a picture posted but I am not able to find that anywhere
  2. Something is bothering me so I just want to rant to someone but my friends are not online or its late at night and I don't want to disturb them.
  3. Don't know who I reach out to for certain issues that I am facing
 
Based on the problems, we came up with the following solutions, which we wanted to achieve with the help of the assistant, Donna
  1. Create a daily planner or a to do and check in with the user on the progress to make them more productive
  2. If available, load some quick videos that they can try out so that these issues get resolved. For instance, how to change a flat tyre.
  3. Have an interaction between the assistant and the page, and load the instagram page with the details of the brands that are selling the same dress 
 
We could track the following metrics to see if the enhancements help improve engagement.
  1. Avg. no. of interactions (1 bot interaction and 1 user response will be 1 interaction) per day
  2. Number of assistant sessions per day
  3. Number of sessions leading to an action (for eg. if we build point 3 above, how many of the sessions led to a purchase decision)
Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

Top Meta (facebook) interview questions


Top Product Improvement interview questions

Top Product Improvement interview questions