15% off membership for Easter! Learn more. Close

How do you measure the success of Instacart?

Asked at Google
10.1k views
eye 10.1k views eye 10.1k views
Answers (6)
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Gold PM

First, I want to briefly cover what Instacart actually does.

From my understanding, Instacart is a delivery service that focuses on online groceries.  Instacart customers log in through a mobile or web app, select and purchase their groceries, which are delivered to their homes.  On the back-end, Instacart finds gig workers who perform the shopping and delivery of the groceries.

 

So moving onto what success for Instacart might look like, let’s first clarify what success means, as it is a bit of a vague term.  In Instacart’s case as a platform, success could mean many things: growing market share, maximizing revenue or profits, growing the platform (i.e., more retailers), etc.  For the purpose of this analysis, I’m going to focus on maximizing monthly recurring revenue.  In Instacart’s case, MRR = # orders per month * avg order value.

 

Let’s walk through the customer journey and identify opportunities to measure and potentially influence MRR:

-       Customer logs into app / web application

-       Customer chooses which store to purchase from 

-       Customer adds items to cart 

-       Customer places an order 

-       Order request goes to the shopper

-       Shopper accepts the order

-       Shopper purchases at the store

-       Shopper delivers the food

-       Customer receives the food

-       Customer rates the shopper 

 

At a high level, this journey maps to:

-       User acquisition – More users likely means more orders!

o   # App downloads per day / week / month

o   # Sign Ups / Account Creations per day / week / month

o   Web / mobile site traffic per day / week / month

-       User activation -- More active users likely means more orders!

o   % Users that place first order within 30 days

o   Avg # Order per Customer per day / week / month

o   Avg # Items per Order 

o   Frequency of Orders placed by Customer (i.e., avg days btwn orders)

-       User retention – More retained users likely means more orders!

o   % Repeat Buyers per day / week / month

o   Churn Rate

o   Referral Rate

o   Avg Shopper Rating per Order

o   NPS

o   Avg # Items available per Retailer

o   % Orders fulfilled on time

-       User monetization – Fully monetized users means maximizing avg order value!

o   Avg Order Size per Customer (ARPU)

o   Average # Orders per day / week / month

o   Average customer acquisition cost

o   Average customer lifetime value

 

Given all of these ideas, I would focus on the following 5 metrics:

(1)   # sign-ups / account creations per week (acquisition)

(2)   Average number of orders per day / week / month (activation)

(3)   Average # items per order (activation)

(4)   Churn over days / weeks / months (retention)

(5)   Average CLV (monetization)

Access expert answers by becoming a member
1 like   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

About Company, Goal and scoping: (not researching before the question) 

I believe Instacart has been founded in the last five years and has been a well-known name in Grocery delivery space. The goal of the company would be to deliver groceries to the end-user with convenience in mind to reduce the frictions involved in physical shopping experience. After inception there have been few competitors would in the space and therefore when considering success matrics I would like to define success from a user and product perspective. I believe that retention, activation and customer satisfaction should be top priorities while concentrating on monetization as the secondary goal. 

Some of the overall matrics to consider would be,

Aquire: How many users downloaded InstaCart.
Activation: How many users registered in InstaCart.
Retention: 
   DAU, MAU
   Daily/Monthly Orders created/completed
   Monthly  Review creation
Monetization:
   Daily/Monthly  Orders created
   Daily/Monthly Orders delivered.
   $$ value of average order.
Satisfaction:
   Positive feedback rate
   Orders delivered in time.
   $$ Saved.

I would select the following two indicators to monitor as high-level indicators to measure the success of InstaCart.

Daily/Monthly Orders created/completed- This could be used to measure retention, engagement and also to gauge is the monetization. If the daily and monthly the number is increasing this means users are engaging and retaining. Also, if the number is increasing this means $$ would be increasing too.
Positive feedback rate - This indicates users are satisfied if the positive feedback rate is increasing. 

 

 

Access expert answers by becoming a member
2 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

Instacart Mission: To create a world where everyone has access to the food they love and more time to enjoy it together. They accomplish it by delivering groceries from local stores with the tagline "Groceries delivered in as little as an hour". 

Instacart Vision: To be the world leader in online grocery.

Business goals: For grocery buyers, Instacart promises convenience at a (somewhat) reasonable price. For local retailers, Instacart promises more sales, higher margins and potentially the ability to cut costs (fewer store workers). Instacart management cares about revenue, profitability and market share (vs. competitors such as Postmates and Blue Apron) and Employees care about work satisfaction and career growth.

The list of possible metrics are:

Buyer metrics:

  • Number of buyers (% growth - by week, month, quarter and year)
  • % of return buyers within 30 days
  • Number of retail stores
  • Number of unique items
  • Avg. number of orders per buyer
  • Avg. order items per buyer
  • Avg. order size ($) per buyer
  • % of orders delivered within 1 hour
  • % of orders delivered same day
  • % of buyers that refer others
  • % of new buyers due to referrals
  • Net promoter score (NPS)

Retailer metrics:

  • Number of orders from Instacart (% growth - by week, month, quarter and year)
  • Avg. number of items per order
  • Avg. order size ($) (compared to in-store purchase)
  • Avg. cost ($) per order (compared to in-store cost)

Business/other metrics:

  • Avg. cost ($) per buyer
  • Avg. profit margin (%) per buyer
  • Market share (%) compared to competitors
  • Employee satisfaction scores
  • Employee retention rate (%)

Prioritized success metrics:

  • #1 - % of orders delivered within 1 hour (aligned with mission)
  • #2 - % of orders delivered same day (aligned with mission)
  • #3 - Number of retail stores (aligned with mission)
  • #4 - Number of unique items (aligned with mission)
  • #5 - Market share (%) by country (compared to competitors) (aligned with vision)

 

 

 

Access expert answers by becoming a member
1 like   |  
1 Feedback
badge Platinum PM

Things you did well

  • Great description of the product: Good summary of the product, its objective and what it does 
  • List of metrics: You came up with a great list of metrics 
  • You broke down the metrics to the three groups of buyers, business, and retailers which is great

Areas of Improvement

  • Overview of the journey: I would have walked the interviewer through the buyer journey and highlighted the relevant metrics for each phase of the user journey just so that you can show that you are thinking holistically about the journey of the buyers and retailers
  • Why measuring a metric: explain the significance of the metrics so the interviewer knows why you’re interested in it
  • Evaluate your metrics: I would have loved to know why you priorized these metrics. Was "aligned with mission" your only criteria? I think there are other criteria such as "level of effort to collect the data" that you want to consider when evaluating your metrics. 

Looking forward to seeing more answers from you! Also, check out this article on how to answer a metrics question. You might find it useful.

2
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge PM

First discuss the Goal: Instacart puts priority on same day delivery with satisfied customers. It's goal is to create a reliable connection between the customers and the shoppers so the customers get more personalized shopping experience. Keeping that in mind, can we assume we are targetting to create better user engagement? Do you have any other goals that you would like to discuss? 

 

Interviewer: Also keep in mind, that we ae focused on the ease of use of the app. This means we need to understand if the customers are able to navigate to the end and come back again. 

 

Interviewee: Great, so we can consider User Engagement and Customer Retention for the scope of this discussion? 

Interviewer: Fair enough. 

Interviewee: Thanks. Is there any specific are you would like to focus on? App or Website? Particular user segments? Demographic preferences?

Interviewer: Not at this point. We can take this discussion on broader area.

Interviewee: 

So we are focusing on

  • Goal as to identify success metrics, user engagement and customer retention
  • Identify this across multiple states (demographic), user segments by age, and considering both mobil and web application.

Below are some metrics for user engagement:

1. Average buyers Count

2. Avergage($) spent by buyers

3. Average order size

4. Average orders per customer

5.Percentage of orders delivered within the same day

Below are some metrics for customer retention:

1. Frequency of order (average number of days between each order)

2. Average number of referrals made

 

The above metrics sliced by

1. Week over week, month over month, time period

2. Different age groups

3. mobile vs web app

Prioritization: 

 

 

Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge Gold PM

About company, Vision, and Goals: (researched after only came across to the question)

About the Company: Inatacart is nearly 8 years old startup that connects users/buyers to the personal shoppers and local retailers in users/buyers area to shop and deliver groceries from the Personal shoppers, retailers, and Instacart store.

Instacart delivers groceries in as little as an hour! Users/Buyers can also buy groceries from Instacart and pick the groceries from available nearest Instacart store.

Vision: To dominate the online grocery industry in the US continent (currently available in the USA and Canada) and world.

Goal: The goal of the company is to deliver groceries to the end-user/Buyers to reduce the trip to the market. and get available groceries at a reasonable price at home/offices and pickup points. for local retailers, Instacart helps to more sales with high margin.

Assumptions 

I would like to focus on the metrics from a user, product perspective and company business goal(revenue, Monetization) and belive user and product would be the primary goal .and below are some I would like to focus on. 

 Acquisition: Where are the users coming from. identify the channel user coming from.   

  • The user coming on the website, mobile site. or 
  • How may users download the Inatacart app?      

To focus on acquisition it is important to evaluate the entire journey of the user and track every step of the user.

Activation:  "How good is the user/customers first experience and future experience during the entire customer life cycle"

  • % of the user use Instacart after download and signup.
  • DAU, and MAU.
  • The average number of orders per day. 
  • The average number of orders, ordered by the user. (Will help to target users whose order value is the below-average number of order)   
  • The average number of items ordered by per user per order. ( Will help to encourage users whose order item is the below-average number of item in a single order  to add more items ) 
  • What item users ordres frequently.        

Retention: How many users are returning to Instacart and why is Instacart losing others.

  • % of return buyer in a day (Daily return user)  
  • % of return buyer in a week (Weekly return user)
  • % of return user in a month (Monthly return user)  
  • Retention rate over daily, weekly and monthly.  

The companion metrics to the Retention is Churn. Churn Rate will tell if you have achieved a good product/Market fit.

  • Customer Churn rate over daily, weekly and monthly.
  • Customer acquisition rate > Customer Churn rate = Growth     

Referral:

  • Net Promotors Score (NPS) 
  • Viral coefficient (viral coefficient should always be greater than 1)  

Revenue/Monetization

  • Average order size ($) per buyer.
  • Average daily/weekly/monthly number of orders.  
  • Decreasing customer acquisition costs.
  • Average customer lifecycle value (customer lifecycle value is the amount of revenue you earn from a customer during their lifecycle).
  • % of market share 

To measure the success of Instacart I would focus on the below metrics.

  1. How Many User download Instacart APP (Acquisition)
  2. DAU and MAU (Activation)
  3. The average number of orders per day(Activation) - If growing directly customer satisfaction and Revenue.
  4. Retention rate over daily, weekly and monthly (Retention)
  5. Viral coefficient (Referral) - Will help in Acquisition
  6. Average customer lifecycle value (customer lifecycle value is the amount of revenue you earn from a customer during their lifecycle).- Growing in customer lifecycle value will help to generate more revenue 

 

    

Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

How would you measure success for Instacart?

 

Instacart is a leading online grocery delivery business and follows a mission to create a world where everyone has access to the food they love and more time to enjoy it together.

It works as a 4 sided marketplace for customer/shopper/brands/retailers.

Cust- can order food at home paying necessary fees and having to receive food at convenience.

Shopper- Getting an oppty to make some extra money by working either full time/part time and ensuring to accept orders by customers and delivering them the food requested.

Retailers- get more sales orders through online channel

Brands- marketing the products

 

Business Goal- Activation to have customers come and place order again and higher the sales orders higher the revenue

Customer Journey:

Customer selects the store-> Adds items to cart> Places Order-->Order request goes to Shopper→ accepts the order> purchases at store> delivers the food> customer receives food> gives ratings to shopper.

 

Funnel:

  1. Cust selects store and adds items to cart

  2. Places the order

  3. Shopper delivers

  4. Good exp---> gives good ratings to shopper and places order again

  5. Bad exp→ gives bad rating and never comes back

  6. No ratings--may/may not come

 

Success for Instacart-> 

 

Aha moment → Customer places their first order

Habit moment→ Customer places second order in same month

 

North Star Metric→ 

Number of sales orders per customer monthly; 

Number of orders fulfilled per shopper on daily/weekly/monthly

 

Key Metrics

  1. Funnel conversion from stage to stage.

  2. Number of orders with good ratings to shopper and experience and places the order again--Frequency of order per customer

  3. Avg number of items per order (basket Size)

  4. Avg number of orders per customer weekly/monthly/yearly

  5. Avg $value per sales order

  6. Abandonment rate (where in the path to purchase drop rate is high?)

  7. Average session duration

  8. %orders delivered per hour/day


 

Business metrics:

  1. Subscriber growth rate

  2. Unsubscribers

  3. Cost per Acquisition ( avg costs incurred on promotion/marketing+tech infrastructure+content development)

  4. Email Open rate

  5. Email CTR

  6. Display Ads CTR

  7. Pay per Click traffic volume

  8. Blog traffic

  9. %orders delivered by referrals--NPS

 

Retailer Metrics:

  1. Top 10% retailers in terms of market share

  2. Average basket size per retailer

  3. #of retail stores signed up with Instacart

  4. Avg $ sales order value per retailer

 

Shopper metrics:

  1. Shopper Satisfaction CSAT

  2. #orders fulfilled per shopper daily/weekly/monthly

  3. Avg Order size/volume delivered per shopper

  4. #bulk loads vs light loads delivered per shopper

  5. Frequency of shopper weekly/monthly/annually

  6. Idleness (shoppers > customer orders in specific regions

  7. Lost deliveries (customer order > shopper supply in high demand regions)

 

Prioritize as per mission and business goal:

  1. Frequency of order placed by customer--Activation

  2. %of orders fulfilled in 1 hour/ day--Mission

  3. Subs growth rate--Revenue

  4. #orders fulfilled per shopper daily/weekly/monthly-Partners aligned to achieve mission

  5. Top 10% retailers in terms of market share--Partner aligned to achieve mission

 

Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs