Zoom has integrated AI into their system, which includes automated notes, and since then, the number of meetings has reduced. What will you do?
Asked at
Zoom
How to answer Problem Solving questions
Interview Guide
Answers (1)
You'll get access to over 3,000 product manager interview questions and answers
Recommended by over 100k members
ago
Zoom has integrated AI for taking notes, and then meetings has reduced
Was the drop in meetings immediately after AI integration or gradual? Gradual
Since when are we seeing this issue? last 1 week
Is it specific to any geography? No
What type of meetings ? Status update, stand up , strategic calls?
Has the no. of active users decreased or just that people are attending lesser meetings?
Metrics impacted -
- Meeting count per user
- AI feature usage
- NPS
- Churn rate
Hypothesis -
Internal factors -
- Did we release any new feature? Yes, AI integration
- Were there any bugs introduced into the system? Not aware
- Were there any changes in the UI post AI integration? Yes, note taker tab gets added automatically when a call is in progress
- Were there many call drops noticed during the meeting?
- Was there any drop in the overall quality of the meetings - audio/ video/ emojis. etc.?
- How good is the accuracy of the note taker?
- Are users able to engage well with the new AI feature, which might have reduced the need for a meeting?
External factors -
- Users might have privay concerns with AI recording the call for note taking?
- Did we inform users about the AI note taker feature before the release? No, as part of release note
- Are there other competitors with the AI note taker feature?
- Do we know the user behaviour when they had launched it?
- Are there any govt regulations against using these kind of features? No
- Was there any internet issue over the past few days? No
- Was there any negative PR regarding data privacy issue with introduction of AI? No
- Have we received any user complaints?
- Has it increased recently? Yes
- Do we have the split of reasons
- Has it increased recently? Yes
Validation -
We need to check the call drop rate during meetings before and after the AI feature release. If the data is similar, then we can rule out this issue.
If we have the competitor launch trend analysis, then the trend might be similar for Zoom as well.
We can rule out the govt/ internet issues, since there are no such issues raised.
We need to analyse the complaints data and categorise them into major buckets and find out the big ticket items
If the AI usage has increased, then people don't feel the need for a meeting, as they get the meeting summary once the meeting is over
Next steps -
Short term -
- Conduct a A/B testing with target group people having AI note taker removed and control group with the AI note taker feature. Check the meeting frequency. If it increases for the target group, it would justify that people have concerns with the AI feature.
- In case of positive result, we need to check the AI feature adoption. If that is good, this would mean meetings are becoming redundant, then we don't need anything to do. But, if the AI feature adoption is low, then we need to educate our users about the data security issues and AI feature's effective usage through public blogs
- In case of negative result, we need to reprioritise our roadmap and include the big tickets items from customer complaints into our roadmap for faster issue resolution.
0 likes | 0 feedback
Top Zoom interview questions
- Zoom has introduced a new feature that allows users to send emoji reactions during meetings. How would you assess the effectiveness of this new feature?2 answers | 988 views
- How would you design a product like Zoom, but for students?2 answers | 817 views
- You've noticed a significant increase in customer complaints about inaccurate billing in the Zoomcar app. Customers report discrepancies between the charges quoted during booking and the final amount billed to their accounts. As a product manager, how would you identify the root cause(s) of this issue?1 answers | 200 views
- See Zoom PM Interview Questions
Top Problem Solving interview questions
- A metric for a video streaming service dropped by 80%. What do you do?50 answers | 135k views
- You launched a new signup flow to encourage new users to add more profile information. A/B test results indicate that the % of people that added more information increased by 8%. However, 7 day retention decreased by 2%. What do you do?29 answers | 28.8k views
- Drivers are dropping out of a city on Lyft. How do you figure out what's going on?23 answers | 18.8k views
- See Problem Solving PM Interview Questions
Top Zoom interview questions
- How would you measure customer success for a newly launched product?1 answers | 294 views
- How would you improve Zoom?1 answers | 1.5k views
- You are the Product Manager for Zoom Chat. How would you improve it?1 answers | 1.3k views
- See Zoom PM Interview Questions
Top Problem Solving interview questions
- Your new feature boosts Amazon Search by 10%, adds 2s to load time. What do you do?19 answers | 36k views
- There is a 15% drop in the open rate of Instagram App. You are the PM. Tell us what could have happened.11 answers | 10.1k views
- There is a data point that indicates that there are more Uber drop-offs at the airport than pick-ups from the airport. Why is this the case and what would you do within the product to change that?10 answers | 22k views
- See Problem Solving PM Interview Questions