As a PM at Amazon, if returns and cancellations have recently peaked, how would you go about identifying the root cause?
You'll get access to over 3,000 product manager interview questions and answers
Recommended by over 100k members
Returns and Cancellations have recently peaked in Amazon.
Since when is the issue observed? Last one week
Is it gradual/ sudden? Gradually and then peaked
Is it specific to any geography? India
Is it specific to any item category? Not sure
Key metrics impacted -
Cancellation rate -
Do we know these are buyer initiated or seller initiated cancellations? Buyer
For this discussion , would like to limit the core business to e-commerce as the returns/ cancellation are msot common in this business as compared to AWS and advertising
Possible flows -
Order placed -> Order confirmed -> Order processed -> Order in-transit -> Order delivered [No returns/ cancellation]
Order placed -> Order confirmed -> Order processed -> Order in-transit -> Order refused
This typically happens when buyer wants to cancel the order, but the order is already in-transit
Order placed -> Order confirmed -> Order processed -> Order cancelled
Need to evaluate the cancellation reasons
Order placed -> Order confirmed -> Order processed -> Order in-transit -> Order delivered -> Order returned
Need to evaluate the return reasons
Do we have any data on the returns and cancellations? Specific to the split of reasons so as to identify the top issues
Possible hypothesis -
- Buyer related -
- Got a better price elsewhere
- Purchased a wrong item
- Fit issue
- Color/ Variant issue
- Undue advantage of the returns policy
- Seller related -
- Inaccurate product images/ description
- Wrong item sent
- Processing was delayed
- Stock out scenario
- Ops related -
- In transit delay
- Package theft/ lost/ damaged
- Address navigation issue
- If it's a product description issue ->
- More stringent QA
- Flag high return skus
- Train the seller on the importance of accurately updating the product description in the website
- If it's a delay related issue ->
- Notify customer and remove sla promise
- If it's a fit related issue ->
- Add size chart, AI recommender for size in the PDP page
- If there is a high return rate from a specific buyer ->
- Flag the skus
- Discuss with customer and check the genuineness of the issue
- If it is related to 3P seller frauds ->
- Blacklist the seller and remove all their listings
(I only answered the topline bold question and answered my own clarifying questions so a bit more generic)
Context setting
Amazon is a company looking to connect customers across the globe with the products they are looking for from a diverse catalogue of sellers and vast assortment. Customer satisfaction is a c central goal to growing Amazon's footprint and spikes in returns and cancellations may indicate reduced satisfaction so it is imperative to get to the root cause.
Clarifications:
1. I will assume this is order returns and order cancellations (as opposed to subscription cancellations)
2. I will assume the peak is in the NA market (as in NA buyers) and fairly uniformly
3. was this subscribe and save orders or all orders? all
4. What is the recency window? 3 months
5. Have they steadily. increased and now plateaued at a peak? yes
6. Peak for how long so far? 2 weeks
7. So at this timeframe it is not likely resultant from a recent holiday such as Christmas or Black Friday? assume no
Restate problem
In the last three months order returns and cancellations from NA buyers have steadily increased to a peak which has been sustained for a couple weeks. This is not expected to be attributable to a holiday event but the root cause is as yet unknown.
Structure:
Internally controlled factors
1.customer
a decreased order satisfaction due to various factors such as colour shape size function
b customer ordered more than what was needed with intent to return some items
c customer unsatisfied with order processing delay
2.business
a platform not connecting searched to the right assortment leaving customers wanting more choice
b value proposition not attractive for new sellers leading to stagnant assortment in some categories
c return and cancellation policy nudging undesirable customer behavior
d shipping policies leading to delayed seller shipping
3.seller
a poor item description
b product does not match the description
c sellers shipping damaged or wrong items
Externally controlled factors
1.customer
a customer found items cheaper or more attractive elsewhere
b customer unsatisfied with shipping delay or undelivered items (from contracted or local shipping)
2.business
a contracted logistics teams not meeting SLAs for delivery
b pricing and assortment is not competitive on the market
c competitor platforms are gaining market share
3.seller
a not enough new sellers onboarding
b poor seller customer service
I would identify the root cause from the above list of potential causes (assuming the above list is exhaustive- I would validate this). Not that any one of these root causes would have a number of likely more granular root causes so it may be necessary to do an issue tree or repeat root cause investigation.
I would assume that the internally controlled factors are within the control of the business and have a policy, strategy or technical solution available with internal resource allocation which may be important in prioritizing.
Then my solution would be
1. I would identify segments, sellers, categories, local markets (ie. rural or urban) and other factors that may be causing the peak by investigating distributions of these variables in a descriptive analysis
2. I would narrow my list of root causes ruling out irrelevant ones and assess effort and impact where more than one root cause needs prioritization.
3. Investigate the root causes at play with respect to the key variables from the descriptive analysis. For example if a customer found more attractive product elsewhere we may see that certain categories are not well represented or if there was a wide problem of seller misinformation there would be a a segment of sellers yielding higher returns.
4. Once I have the top root causes and the descriptive data to support I would craft an approach by diving deeper into the issue and listing out the use cases.
For example imagine that sellers from France have poor information provided to their NA market. We see in the data that there are increased wrong item returns from French sellers. In this case I would probably need to do another root cause analysis to determine what the driver of widespread poor product descriptions is like translation software or other. But then I would have
use case one: build GenAI to identify content gaps
use case two: build seller facing tool
use case three:
use case four:
...
use case n:
Perform a prioritization base on effort and impact.
repeat for each root cause.
As a bonus I would also probably tie back to an enterprise strategy ie. what if Amazon aims to have 30% of all product pages assessed by GenAI tooling or aims to have X number of sellers from any representative country etc. I'd also think about things like whether investing effort in a problem tied to a locale is aligned with the financial strategy of the enterprise. Anything that brings a global view.
Some clarifying Questions
- When you say Returns and Cancelltions have peaked
- Return - You mean users are order product and than returning it back within a situpalted timeline which is assigned for return ?
- Does the return happen on same day or
- Does it it happen within let us say 7 days (assuming amazon return policy has 7 days mentioned)
- Return - You mean users are order product and than returning it back within a situpalted timeline which is assigned for return ?
- Talking abour cancellation - Does this means users order the product and a cancel it ? - answer yes
- So when is the cancellation happening
- Same day
- Next day
- Day of delivery ?
- Does amazon allow cancellation till delivery - Yes
- Also the tool which is tracking the returns and cancellation is it working fine
- Does it fire all events correctly
- Does it record data correctly ?
- Since when have you seen the spike in
- Returns - Last 7 days
- Cancellation - Last 7 days
- Are these returns happening for specific
- Geo
- Platform
- User journey - user goes to app/web discovers t shirts via search, via product display in some section on homepage or recommended section in product details page> Chooses the product >chooses size/colour> Adds the adreess or selects from prefilled ones>makes the payment and gets order confirmation> post which user can go to orders section and cancel it - Is there something different that we are displaying on the order confirmation page ?
- Do we have any complaints that users have made recently about mentioning that product is not what they ordered in orders page ? - No such complaint
- Did we make a release recently for orders page with any feature in reference to cancealltion ?
- Ya we have started displaying timelines with new UI
- Ordered>InTransit>Delivery in 7 days >Date of delivery
- Did we cross verify if the information shown on timelines due to release of this feature is correct?
- Yes we did the timelines is as per delivery schedule
- did we check that no of days vs date does that match ?
- We have ran a querry where we found 10 cases like these where delivery date and no days does not match
- Ya we have started displaying timelines with new UI
- Is the position of cancel button changed - Answer - No only timeline is added about it
- Also the amount paid and method of payment along with order deatils are they all correct did we cross verify this
- In certain cases we have noticed that amout paid is show 10 % higher than what is charged
- User journey - Order page>status =delivered> Request for Return > Choose the reason for return
- What reasons are users essentially choosing
- did we call these customers and tried to check with them what went wront
- yes there are multiple reasons
- Some are saying product is damaged, colour is not as per expecation, size is not fitting
- yes there are multiple reasons
- Did we know who is the retailer who is supplying these t shirts
- yes there are 4 such retilers who are supplying these t shirts
- Does this retailer deliver product from amazon facility or manages to deliver by himself
- these 4 retailers all them deliver by themselves
- Did we not visit and make neccessary audits for these retiler we did but during the audit there was no issue
- did we order some sample products and check this
- yes and we realised that these reatilers are showing diff images but actualy delivering a poor quality product
- As per SOP please would suggest to provide warnings to avoid such delivery or esle we will have ban thier account
- Let us keeep a track on these complaints
Top Amazon interview questions
- A metric for a video streaming service dropped by 80%. What do you do?50 answers | 135k views
- Design a library for the future.25 answers | 23.5k views
- Your new feature boosts Amazon Search by 10%, adds 2s to load time. What do you do?19 answers | 36k views
- See Amazon PM Interview Questions
Top Problem Solving interview questions
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?29 answers | 28.8k views
- Drivers are dropping out of a city on Lyft. How do you figure out what's going on?23 answers | 18.8k views
- There is a 15% drop in the open rate of Instagram App. You are the PM. Tell us what could have happened.11 answers | 10.1k views
- See Problem Solving PM Interview Questions
Top Amazon interview questions
- How would you improve Amazon?14 answers | 35k views
- How would you determine if a specific block in your neighborhood is suitable for a new grocery store?14 answers | 13.4k views
- You have a grocery delivery service that delivers food within 24 hours. How many trucks would you need to operate it?12 answers | 29.8k views
- See Amazon PM Interview Questions
Top Problem Solving interview questions
- There is a data point that indicates that there are more Uber drop-offs at the airport than pick-ups from the airport. Why is this the case and what would you do within the product to change that?10 answers | 22k views
- You are a PM at Uber or Ola. You have to upsell Uber Go to Uber Auto customers. How would you go about it? What product changes would you make?9 answers | 3.5k views
- Utilization went down by 45% on app XYZ in Italy for the month of August. Give a reason why and draft a plan to fix it.7 answers | 3k views
- See Problem Solving PM Interview Questions