15% off membership for Easter! Learn more. Close

As a PM at Amazon, if returns and cancellations have recently peaked, how would you go about identifying the root cause?

What process or framework would you use to identify the root cause of this peak? Additionally, which core business and product levers would you prioritize examining?
Asked at Amazon
488 views
Answers (3)
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Platinum PM
ago

Returns and Cancellations have recently peaked in Amazon.

Since when is the issue observed? Last one week

Is it gradual/ sudden? Gradually and then peaked

Is it specific to any geography? India

Is it specific to any item category? Not sure

Key metrics impacted -

Cancellation rate -

Do we know these are buyer initiated or seller initiated cancellations? Buyer

For this discussion , would like to limit the core business to e-commerce as the returns/ cancellation are msot common in this business as compared to AWS and advertising

Possible flows -

Order placed -> Order confirmed -> Order processed -> Order in-transit -> Order delivered [No returns/ cancellation]

Order placed -> Order confirmed -> Order processed -> Order in-transit -> Order refused

This typically happens when buyer wants to cancel the order, but the order is already in-transit

Order placed -> Order confirmed -> Order processed -> Order cancelled

Need to evaluate the cancellation reasons

Order placed -> Order confirmed -> Order processed -> Order in-transit -> Order delivered -> Order returned

Need to evaluate the return reasons

Do we have any data on the returns and cancellations? Specific to the split of reasons so as to identify the top issues

Possible hypothesis -

  • Buyer related -
    • Got a better price elsewhere
    • Purchased a wrong item
    • Fit issue
    • Color/ Variant issue
    • Undue advantage of the returns policy
  • Seller related -
    • Inaccurate product images/ description
    • Wrong item sent
    • Processing was delayed
    • Stock out scenario
  • Ops related -
    • In transit delay
    • Package theft/ lost/ damaged
    • Address navigation issue
To further identify the root cause, we need to further analyze the data from above lens -
User segmentation across geography, sex, item categories purchased, sellers (1P v/s 3P) and then identify the most impacted segment which will narrow it down to the root cause. Based on the identified issue, the next course of action can be decided.
 
Possible recommendations -
  • If it's a product description issue -> 
    • More stringent QA
    • Flag high return skus
    • Train the seller on the importance of accurately updating the product description in the website
  • If it's a delay related issue ->
    • Notify customer and remove sla promise
  • If it's a fit related issue ->
    • Add size chart, AI recommender for size in the PDP page
  • If there is a high return rate from a specific buyer ->
    • Flag the skus
    • Discuss with customer and check the genuineness of the issue
  • If it is related to 3P seller frauds ->
    • Blacklist the seller and remove all their listings
Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
badge Silver PM

(I only answered the topline bold question and answered my own clarifying questions so a bit more generic)

 

Context setting
Amazon is a company looking to connect customers across the globe with the products they are looking for from a diverse catalogue of sellers and vast assortment. Customer satisfaction is a c central goal to growing Amazon's footprint and spikes in returns and cancellations may indicate reduced satisfaction so it is imperative to get to the root cause.

Clarifications:
1. I will assume this is order returns and order cancellations (as opposed to subscription cancellations)
2. I will assume the peak is in the NA market (as in NA buyers) and fairly uniformly
3. was this subscribe and save orders or all orders? all
4. What is the recency window? 3 months
5. Have they steadily. increased and now plateaued at a peak? yes
6. Peak for how long so far? 2 weeks
7. So at this timeframe it is not likely resultant from a recent holiday such as Christmas or Black Friday? assume no

Restate problem

In the last three months order returns and cancellations from NA buyers have steadily increased to a peak which has been sustained for a couple weeks. This is not expected to be attributable to a holiday event but the root cause is as yet unknown.

Structure:

Internally controlled factors
1.customer
a decreased order satisfaction due to various factors such as colour shape size function 
b customer ordered more than what was needed with intent to return some items
c customer unsatisfied with order processing delay
2.business
a platform not connecting searched to the right assortment leaving customers wanting more choice
b value proposition not attractive for new sellers leading to stagnant assortment in some categories
c return and cancellation policy nudging undesirable customer behavior
d shipping policies leading to delayed seller shipping
3.seller
a poor item description
b product does not match the description
c sellers shipping damaged or wrong items

Externally controlled factors
1.customer
a customer found items cheaper or more attractive elsewhere
b customer unsatisfied with shipping delay or undelivered items (from contracted or local shipping)
2.business
a contracted logistics teams not meeting SLAs for delivery
b pricing and assortment is not competitive on the market
c competitor platforms are gaining market share
3.seller
a not enough new sellers onboarding
b poor seller customer service

I would identify the root cause from the above list of potential causes (assuming the above list is exhaustive- I would validate this). Not that any one of these root causes would have a number of likely more granular root causes so it may be necessary to do an issue tree or repeat root cause investigation.

I would assume that the internally controlled factors are within the control of the business and have a policy, strategy or technical solution available with internal resource allocation which may be important in prioritizing.

Then my solution would be
1. I would identify segments, sellers, categories, local markets (ie. rural or urban) and other factors that may be causing the peak by investigating distributions of these variables in a descriptive analysis
2. I would narrow my list of root causes ruling out irrelevant ones and assess effort and impact where more than one root cause needs prioritization.
3. Investigate the root causes at play with respect to the key variables from the descriptive analysis. For example if a customer found more attractive product elsewhere we may see that certain categories are not well represented or if there was a wide problem of seller misinformation there would be a a segment of sellers yielding higher returns.
4. Once I have the top root causes and the descriptive data to support I would craft an approach by diving deeper into the issue and listing out the use cases.

For example imagine that sellers from France have poor information provided to their NA market. We see in the data that there are increased wrong item returns from French sellers. In this case I would probably need to do another root cause analysis to determine what the driver of widespread poor product descriptions is like translation software or other. But then I would have

use case one: build GenAI to identify content gaps
use case two: build seller facing tool
use case three:
use case four:
...
use case n:

Perform a prioritization base on effort and impact.

repeat for each root cause.

As a bonus I would also probably tie back to an enterprise strategy ie. what if Amazon aims to have 30% of all product pages assessed by GenAI tooling or aims to have X number of sellers from any representative country etc. I'd also think about things like whether investing effort in a problem tied to a locale is aligned with the financial strategy of the enterprise. Anything that brings a global view.

Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs

Some clarifying Questions 

  1. When you say Returns and Cancelltions have peaked 
    1. Return - You mean users are order product and than returning it back within a situpalted timeline which is assigned for return ? 
      1. Does the return happen on same day or 
      2. Does it it happen within let us say 7 days (assuming amazon return policy has 7 days mentioned) 
Answer - It can happen any time 1 st or 2nd day 
 
  1. Talking abour cancellation - Does this means users order the product and a cancel it ? - answer yes 
  2. So when is the cancellation happening 
    1. Same day 
    2. Next day 
    3. Day of delivery ?
Answer - Day of Delivery 
  1. Does amazon allow cancellation till delivery - Yes 
  2. Also the tool which is tracking the returns and cancellation is it working fine
    1. Does it fire all events correctly 
    2. Does it record data correctly ?
  3. Since when have you seen the spike in 
    1. Returns - Last 7 days 
    2. Cancellation -  Last 7 days 
  4. Are these returns happening for specific 
    1. Geo
    2. Platform 
Answer is no 
 
So what is return and cancellation in a idea scenario 
 
return - users return a product in a stipulated timeline given to them considering the fact that either product is not what they ordered for, or if its clothing it does not fit in or is not comfortable or they dont like product 
 
that reminds me is this happening in a certain category for a specific retailer - No for specific retailer but for Amazon t shirts 
 
got it 
 
This is some information 
 
Internal factors (Cancellation)
  1. User journey - user goes to app/web discovers t shirts via search, via product display in some section on homepage or recommended section in product details page> Chooses the product >chooses size/colour> Adds the adreess or selects from prefilled ones>makes the payment and gets order confirmation> post which user can go to orders section and cancel it - Is there something different that we are displaying on the order confirmation page ?
    1. Do we have any complaints that users have made recently about mentioning that product is not what they ordered in orders page ? - No such complaint 
  2. Did we make a release recently for orders page with any feature in reference to cancealltion ?
    1. Ya we have started displaying timelines with new UI
      1. Ordered>InTransit>Delivery in 7 days >Date of delivery 
    2. Did we cross verify if the information shown on timelines due to release of this feature is correct?
      1. Yes we did the timelines is as per delivery schedule 
    3. did we check that no of days vs date does that match ?
      1. We have ran a querry where we found 10 cases like these where delivery date and no days does not match 
I think this could be one possible reason for it , let us deep dive in to it more 
 
  • Is the position of cancel button changed - Answer - No only timeline is added about it 
  1. Also the amount paid and method of payment along with order deatils are they all correct did we cross verify this 
    1. In certain cases we have noticed that amout paid is show 10 % higher than what is charged 
 
I think the above issue of showing incorect amount and date issue should be possible reason, did we cross verify this with users who were displayed incorect date/amout- how many of them ended up cancelling 
 
yes so 100 users we displayed incorrect info 70 ended up cancelling. 
 
This prooves that issue needs to be fixed on warfooting basis.
 
External factor - Though we have a possible idea of cancellation i am not geting in to factors like competitor offering same or similar tshirts to amazon customers at cheaper prize or running any discounts /negative pr or news which forcing users to cancel the order is that ok ? - yes its ok
 
 
Coming to Returns 
 
Internal factors (Return)
  1. User journey - Order page>status =delivered> Request for Return > Choose the reason for return 
    1. What reasons are users essentially choosing 
Most of them are saying they dont want the product 
 
  1. did we call these customers and tried to check with them what went wront 
    1. yes there are multiple reasons 
      1. Some are saying product is damaged, colour is not as per expecation, size is not fitting 
  2. Did we know who is the retailer who is supplying these t shirts 
    1. yes there are 4 such retilers who are supplying these t shirts 
  3. Does this retailer deliver product from amazon facility or manages to deliver by himself 
    1. these 4 retailers all them deliver by themselves 
  4. Did we not visit and make neccessary audits for these retiler we did but during the audit there was no issue 
  5. did we order some sample products and check this
    1. yes and we realised that these reatilers are showing diff images but actualy delivering a poor quality product 
  6. As per SOP please would suggest to provide warnings to avoid such delivery or esle we will have ban thier account 
  7. Let us keeep a track on these complaints 
sucess metric 
No of complaints week on week/month on month 
Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs