You are a PM at a food delivery firm. Your data analyst comes up to you and tells you that there is a spike at breakfast, dinner and lunch time. However, at lunch, the conversion is 2% when compared to dinner and breakfast which is 10%. How would you go about solving this problem?
Asked at
Amazon
How to answer Problem Solving questions
Interview Guide
Answers (3)
You'll get access to over 3,000 product manager interview questions and answers
Recommended by over 100k members
I am working at a food delivery service whereby users log in via mobile or web application, select a restaurant, add food items to a cart, pay and checkout. My delivery service then submits the orders to gig economy workers who pick up the food and deliver it to the customer. I am currently seeing a trend whereby traffic spikes at breakfast, lunch and dinner, but the conversion rate is much lower around lunchtime. I am tasked with figuring out why conversion is so much lower at lunch. I will assume conversion = number of purchases / number of app searches.
First, I'd like to know what this data reflects. Over what period of time was this data taken? Across which segments (mobile vs web, android vs iOS, geography, browser, etc)?
Assuming this reflects the overall product, I would brainstorm some possible reasons why conversion may be lower:
Internal Factors
- Product Changes - We changed something in the app that made it more difficult to checkout. We changed something in the app that boosted the number of app searches.
- Product Quality - Our delivery time windows are unusually large, deterring customers from ordering.
External Factors
- User Habits - Lunch conversion rates on food delivery apps are lower across the industry.
- Competition - Our competitors have a better selection of restaurants, more competitive pricing or lower delivery fees at lunch than we do.
In considering these potential reasons, I think the most plausable relate to product quality and/or competition. Conversion rate is lower either because we have a problem with our lunchtime offering - e.g., there are less couriers at lunchtime so our wait times are longer, OR our competitors offer better pricing or selection. To further explore these potential issues, I'd look at the following data points:
- avg # competitor lunchtime restaurants vs. ours
- avg competitor lunchtime conversion rate vs. ours
- avg competitor lunchtime delivery fee vs ours
- avg competitor lunchtime order value vs ours
- avg delivery window lunchtime vs. breakfast vs. dinner
- % abandoned carts lunchtime vs. breakfast vs. dinner
- % users who add to cart lunchtime vs breakfast vs dinner
In taking a closer look at these metrics, I will be better able to identify the root cause.
First, I'd like to know what this data reflects. Over what period of time was this data taken? Across which segments (mobile vs web, android vs iOS, geography, browser, etc)?
Assuming this reflects the overall product, I would brainstorm some possible reasons why conversion may be lower:
Internal Factors
- Product Changes - We changed something in the app that made it more difficult to checkout. We changed something in the app that boosted the number of app searches.
- Product Quality - Our delivery time windows are unusually large, deterring customers from ordering.
External Factors
- User Habits - Lunch conversion rates on food delivery apps are lower across the industry.
- Competition - Our competitors have a better selection of restaurants, more competitive pricing or lower delivery fees at lunch than we do.
In considering these potential reasons, I think the most plausable relate to product quality and/or competition. Conversion rate is lower either because we have a problem with our lunchtime offering - e.g., there are less couriers at lunchtime so our wait times are longer, OR our competitors offer better pricing or selection. To further explore these potential issues, I'd look at the following data points:
- avg # competitor lunchtime restaurants vs. ours
- avg competitor lunchtime conversion rate vs. ours
- avg competitor lunchtime delivery fee vs ours
- avg competitor lunchtime order value vs ours
- avg delivery window lunchtime vs. breakfast vs. dinner
- % abandoned carts lunchtime vs. breakfast vs. dinner
- % users who add to cart lunchtime vs breakfast vs dinner
In taking a closer look at these metrics, I will be better able to identify the root cause.
Clarifying questions to the data analyst:
1. Over what period of time have you observed this? - to find out if this is a problem generated after any new changes in the customer journey or for any external factor like other competitive offers?
2. What was the conversion rate for lunch before this analysis was done? - Has it increased for the others and decreased for lunch? - to understand if the conversion rate with lunch has always been this low
3. During which stage of the order journey customer is dropping off during lunch?
I.Now I would consider the customer journey and understand how it is different when someone orders a lunch vs dinner or breakfast using our app.
Usually breakfast and dinner would be ordered from residence while lunch would be taken at office..often in short time in between meetings. The item search + delivery time + path to be travelled inside office premises to get the parcel would be higher during lunch. ( Assuming food delivery is opted majorly by ppl staying outside home for work)
If this hypothesis is tested and comes out to be true..then the food delivery app might consider corporate tie ups inside canteens to solve this issue.
If there is issue with payment process time, a delayed payment option can be included during lunch.
Metrics to be considered:
%of active users who orders for breakfast and dinner but skips lunch order( doesnot open the app at all)
% of active users who proceeds for lunch order but drops off in the middle
Conversion rate of lunch during weekends
II. Next, are competitor brands offering something during lunch which seems like a tempting offer?
A temporary offer inclusion of similar sort ongoing in other apps can be a small test for this
III. Is food menu to be blamed?
%of item search during lunch showing no result
In that case an option to give suggestion for dish inclusion when not found can help
Tie up with restaurants which provide such items can help too
Out of these 3, we should first check with problem I and III, and based on the test result confidence value go ahead with one. The competition check is required but can be temporary as well based on offers..and if we are seeing an overall performance better than competitors, point II should be checked only if I and III Fail.
1. Over what period of time have you observed this? - to find out if this is a problem generated after any new changes in the customer journey or for any external factor like other competitive offers?
2. What was the conversion rate for lunch before this analysis was done? - Has it increased for the others and decreased for lunch? - to understand if the conversion rate with lunch has always been this low
3. During which stage of the order journey customer is dropping off during lunch?
I.Now I would consider the customer journey and understand how it is different when someone orders a lunch vs dinner or breakfast using our app.
Usually breakfast and dinner would be ordered from residence while lunch would be taken at office..often in short time in between meetings. The item search + delivery time + path to be travelled inside office premises to get the parcel would be higher during lunch. ( Assuming food delivery is opted majorly by ppl staying outside home for work)
If this hypothesis is tested and comes out to be true..then the food delivery app might consider corporate tie ups inside canteens to solve this issue.
If there is issue with payment process time, a delayed payment option can be included during lunch.
Metrics to be considered:
%of active users who orders for breakfast and dinner but skips lunch order( doesnot open the app at all)
% of active users who proceeds for lunch order but drops off in the middle
Conversion rate of lunch during weekends
II. Next, are competitor brands offering something during lunch which seems like a tempting offer?
A temporary offer inclusion of similar sort ongoing in other apps can be a small test for this
III. Is food menu to be blamed?
%of item search during lunch showing no result
In that case an option to give suggestion for dish inclusion when not found can help
Tie up with restaurants which provide such items can help too
Out of these 3, we should first check with problem I and III, and based on the test result confidence value go ahead with one. The competition check is required but can be temporary as well based on offers..and if we are seeing an overall performance better than competitors, point II should be checked only if I and III Fail.
0 likes | 0 feedback
First, I would map the user journey and identify the factors that contribute to conversion in the food delivery app.
1. Search/Discovery: Users can search with different attributes restaurant, dish type, cuisine, etc.
2. Purchase: Users add items in the cart and make a purchase decision basis delivery time, cost of purchase, coupon discount available.
3. Payment: User selects one of the payment options/methods available in the app
Second, I would like to analyze the conversion contributor metrics associated with the three stages identified above, compare them across three meal times, and identify any discrepancies in the process. For eg. I can discover that the average coupon discount available during lunch is 30% lower than that during dinner or breakfast or the number of discount/promotional coupons available is 50% less during lunch when compared to dinner or breakfast or the number of food items available on my app during lunch is significantly lower than breakfast or dinner.
Third, if I am unable to determine any significant discrepancies from the app usage I would like to analyze some if there are any external factors that are contributing to this phenomenon or if there is a behavioral aspect that we may have missed in our root cause analysis.
- competitor conversion rate, delivery fee, food catalog(variety) vs ours
- canteens/mess availability in the concerned region during office hours
- customers intent (they could just be scrolling to decide what they want to order in for dinner)
- customers think it would be a hassle to get the food delivered in the office
Alternatively, you can formulate quick hypotheses and validate them using data.
1. Search/Discovery: Users can search with different attributes restaurant, dish type, cuisine, etc.
2. Purchase: Users add items in the cart and make a purchase decision basis delivery time, cost of purchase, coupon discount available.
3. Payment: User selects one of the payment options/methods available in the app
Second, I would like to analyze the conversion contributor metrics associated with the three stages identified above, compare them across three meal times, and identify any discrepancies in the process. For eg. I can discover that the average coupon discount available during lunch is 30% lower than that during dinner or breakfast or the number of discount/promotional coupons available is 50% less during lunch when compared to dinner or breakfast or the number of food items available on my app during lunch is significantly lower than breakfast or dinner.
Third, if I am unable to determine any significant discrepancies from the app usage I would like to analyze some if there are any external factors that are contributing to this phenomenon or if there is a behavioral aspect that we may have missed in our root cause analysis.
- competitor conversion rate, delivery fee, food catalog(variety) vs ours
- canteens/mess availability in the concerned region during office hours
- customers intent (they could just be scrolling to decide what they want to order in for dinner)
- customers think it would be a hassle to get the food delivered in the office
Alternatively, you can formulate quick hypotheses and validate them using data.
0 likes | 0 feedback
Top Amazon interview questions
- A metric for a video streaming service dropped by 80%. What do you do?50 answers | 135k views
- Design a library for the future.25 answers | 23.5k views
- Your new feature boosts Amazon Search by 10%, adds 2s to load time. What do you do?19 answers | 36k views
- See Amazon PM Interview Questions
Top Problem Solving interview questions
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?29 answers | 28.8k views
- Drivers are dropping out of a city on Lyft. How do you figure out what's going on?23 answers | 18.8k views
- There is a 15% drop in the open rate of Instagram App. You are the PM. Tell us what could have happened.11 answers | 10.1k views
- See Problem Solving PM Interview Questions
Top Amazon interview questions
- How would you improve Amazon?14 answers | 35k views
- How would you determine if a specific block in your neighborhood is suitable for a new grocery store?14 answers | 13.4k views
- You have a grocery delivery service that delivers food within 24 hours. How many trucks would you need to operate it?12 answers | 29.8k views
- See Amazon PM Interview Questions
Top Problem Solving interview questions
- There is a data point that indicates that there are more Uber drop-offs at the airport than pick-ups from the airport. Why is this the case and what would you do within the product to change that?10 answers | 22k views
- You are a PM at Uber or Ola. You have to upsell Uber Go to Uber Auto customers. How would you go about it? What product changes would you make?9 answers | 3.5k views
- Utilization went down by 45% on app XYZ in Italy for the month of August. Give a reason why and draft a plan to fix it.7 answers | 3k views
- See Problem Solving PM Interview Questions