Question

Weekly active users (WAU) for iPhone app dropped. What happened?

Answer 1

Clarity

who are speaking as - apple analyst or analyst for a company like say YouTube, lets assume later since you'll never a random drop in apple device WAU owing to long lifecycle of the devices

Confirm the drop

- Over what period - is it natural or at an abnormal rate

- Was it there last year/month/week

- are we sure it's a drop and not due to a bump sometime in the recent past

- Is the data reliable, did we make changes to any metric definitions and are the data pulls updated or maybe it' didn't update correctly.

 

Start investigation 

internal factors

Any other metrics affected? this will help us narrow down the focus?

Any specific cohorts affected? OS version/Phone/Country/Location/ISP/phone service provider

Any technical issues? check error rates

What are the customers saying - check customer feedback for the same period for iphone users, talk to customers who reported issues

Any major releases that had product design changes or logging changes 

 

External

Any major updates from apple?

Any outages on apple in the recent past

Does the competition also show a simialr drop? 

Any major festivals/downtime across the world ( example california fires ) that could lead to this 

Comments

I would also ask about seasonality.

---

Wouldn't it be covered under - Was it there last year/month/week?

Answer 2

First try to understand the situation by asking clarifications. 1. what is the rate of drop?  (assume it is statistically significant), 2. investigate possible causes: a) are there competive apps similar, b) any broader trends such as negative publicity, c) quality issues that were pending on the app, d) app is data intensive, e) app pricing model changed, f) when was this observed in past day, week, month, quarter?  (for now assume it is a health app such as breathing or pranayama and a new competitive apps is there).

Second, look at the id of users... if they are Boomers, Gen X, Y, Z; geo, psychlogical profiles.....  for now assume that these are mainly Gen X users - mainly women - office and housewives.    

Third, look at the customer needs... women want quick access to app and also want videos and guided talks to help understand and go deeper into practice.   Seems pain point is users now looking for deeper engagements.

ROI - assume drop of 10% causing loss of $100k revenue/month or $20k profit... now to make new videos and improve takes investment of $100k to $500k/... so there is   5 month to much longer breakeven period to recoup investment. however there is upside not counted. also competitor may also improve.

Solutions:  App has to be improved for deeper engagement else will fade away. prioritize with different options: 1. add video, 2. reduce time of loading and make faster, 3. improve UI, 4. add Q&A and 5. Add community forum

look at trade offs including cost and start with simple such as Q&A, then redesign for faster loading and other.

Evaluate the impact of this with reduction in loss of WAU. then iterate with further improvements.

Summary: Root cause for the WAU loss has to be first determined, then looking at potential solutions, pick fast impact one first then iterate.

Answer 3

Weekly active users (WAU) for iPhone app dropped. What happened? 

 

Description: iphone apps are specificially made to work on the iphones. They are made so that they will work with the ios software that powers the iphone. Any iphone app that is not compatible with the ios system will not properly work on the iphone. 

 

Clarification: we know this is a progressive decline and not sudden. so we know there is a fundamental shift in way people are accessing their apps.

                    1) is this decline specific to USA or world wide (USA only)

                    2) If USA is this specific to a certain state, city, region (no)

                    3) all apps or a particular app is giving issues ( all apps)

                    4) Has this happened before, seasonal (no)

                   5) use meaning. the use of app on the phone (yes)

                   6) not related to devlopment of iphone apps( correct)

                   

 

The Hypothesis:

1. I phone users have found an alternative way to access their apps 

2. I phone users are having problems opening their apps

3. I phone users are having a bad experience when using their apps

 

I am going to first investigate external reasons that may be influencing this change and then will look at internal factors so investigate the problem further.

 

External Factors

1.  New competitors granting a more fun easier way to access the apps. people migrating to android phones. is the android market suddendly showing capturing better market share. Perhaps there is a new phone out with amazing features and iphone users are now using andriod phones to access their apps through the andriod platform. Will check for if there is a sudden spike in android phone sales. or a sudden increase in android downloads.

2.  PR Issue: Is there news about data breach on hack regarding iphone or its app that is making people uncomfortable using apps through iphone.

3.  Will check with my engineering team if thers is a possibility of a bug or cyberattack that is causing an interruption in iphone app experience

4.  I will also discover if this progressive decline in app usage is present in android app as well. This will point to the fact that there is either a significant shift in how people are accessing their apps or that a hack or bug has affected all apps and hence affecting app usage.

5.will check if there is a problem with downloading and loading apps from the ios store. That might be causing negative experience but I would imagine that to be caught by their QA team .  so i would rule that out from progressive decline.

6. Regulations: Changes in laws or regulations causing privacy concerns for users, they may feel like their information is not safe of they are being monitored, watched, regulated.  I will check to see if there is such a sentiment prevailing in the iphone users and or android users as well.

 

Assuming that the progressive decline is not caused by a new competitor or a new way to access apps. Assuming it is no android stealing mkt share. There is no known cyber attack, bug or privacy or data breaches that would affect public sentiment and no regulations that have affected the use of iphone or android app usage I will investigate the internal factors that can be causing the drop.

 

Internal Factors:

1. I will check with my engineering team to see if there is any latest update to the apple ios system that is coinciding with the drop of iphone app usage. I will investigate if there is a change in the way iphone apps functionality affected by the update.

 

2. Is it affecting all devices or a particular device? That will help me narrow the scope of the problem to see if there is a 

 

3. check if there is an issue with downloading the apps from the AppStore. An issue with that can cause a gradual negative experience 

 

4. check to see if there is a problem with pushing iphone app updates and also check if that is all over or particular in a specific device

5.  Check if there is a problem with loading time of the i phone apps. that could mean that the apps are either not being updated properly and are being stuck in a bad loop and or its not compatible with the device it is on.

6. Check if the iphone apps are just takign too much space or draining battery life on the phones and the users are now just opting to either not use the apps or turning to use it elsewhere

7. Check if there are reports of iphone apps crashing on all devices or some devices that would help narrow the focus to finding the problem. it could be not updating, or the app is not compatible with the device it is on. That also happens with alot of older phones. So scoping down the device focus would be helpful.

8.  I will check to see if there is a problem with app display in all or specific devices. apps not displaying properly can also cause a WAU to go down

 

 

 

Summary: It would help to narrow down the scope of the problem to a particular device. Look at external factors first that may be influencing any major shift in change in behavior. Following internal user flow investigation across all devices to check if the problem is focused on one device or is across all devices.