15% off membership for Easter! Learn more. Close

Zoom has integrated AI into their system, which includes automated notes, and since then, the number of meetings has reduced. What will you do?

Asked at Zoom
185 views
Answers (1)
crownAccess expert answers by becoming a member

You'll get access to over 3,000 product manager interview questions and answers

badge Platinum PM
ago

Zoom has integrated AI for taking notes, and then meetings has reduced

Was the drop in meetings immediately after AI integration or gradual? Gradual

Since when are we seeing this issue? last 1 week

Is it specific to any geography? No

What type of meetings ? Status update, stand up , strategic calls?

Has the no. of active users decreased or just that people are attending lesser meetings?

Metrics impacted -

  • Meeting count per user
  • AI feature usage
  • NPS
  • Churn rate

Hypothesis -

Internal factors -

  • Did we release any new feature? Yes, AI integration
  • Were there any bugs introduced into the system? Not aware
  • Were there any changes in the UI post AI integration? Yes, note taker tab gets added automatically when a call is in progress
  • Were there many call drops noticed during the meeting?
  • Was there any drop in the overall quality of the meetings - audio/ video/ emojis. etc.?
  • How good is the accuracy of the note taker?
  • Are users able to engage well with the new AI feature, which might have reduced the need for a meeting?
External factors -
  • Users might have privay concerns with AI recording the call for note taking?
    • Did we inform users about the AI note taker feature before the release? No, as part of release note
  • Are there other competitors with the AI note taker feature?
    • Do we know the user behaviour when they had launched it?
  • Are there any govt regulations against using these kind of features? No
  • Was there any internet issue over the past few days? No
  • Was there any negative PR regarding data privacy issue with introduction of AI? No
  • Have we received any user complaints?
    • Has it increased recently? Yes
      • Do we have the split of reasons
Validation -
We need to check the call drop rate during meetings before and after the AI feature release. If the data is similar, then we can rule out this issue.
If we have the competitor launch trend analysis, then the trend might be similar for Zoom as well.
We can rule out the govt/ internet issues, since there are no such issues raised.
We need to analyse the complaints data and categorise them into major buckets and find out the big ticket items
If the AI usage has increased, then people don't feel the need for a meeting, as they get the meeting summary once the meeting is over
 
Next steps -
Short term -
  • Conduct a A/B testing with target group people having AI note taker removed and control group with the AI note taker feature. Check the meeting frequency. If it increases for the target group, it would justify that people have concerns with the AI feature.
  • In case of positive result,  we need to check the AI feature adoption. If that is good, this would mean meetings are becoming redundant, then we don't need anything to do. But, if the AI feature adoption is low, then we need to educate our users about the data security issues and AI feature's effective usage through public blogs
  • In case of negative result, we need to reprioritise our roadmap and include the big tickets items from customer complaints into our roadmap for faster issue resolution.
Access expert answers by becoming a member
0 likes   |  
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs
Get unlimited access for $12/month
Get access to 2,346 pm interview questions and answers to give yourself a strong edge against other candidates that are interviewing for the same position
Get access to over 238 hours of video material containing an interview prep course, recorded mock interviews by expert PMs, group practice sessions, and QAs with expert PMs
Boost your confidence in PM interviews by attending peer to peer mock interview practices, group practices, and QA sessions with expert PMs