How would you improve the MS Teams search functionality as a Search PM at Microsoft Teams?
What improvements would you implement, and what metrics would you prioritize to measure the effectiveness of the MS Teams search feature?
Asked at
Microsoft
How to answer Product Improvement questions
Interview Guide
Answers (1)
You'll get access to over 3,000 product manager interview questions and answers
Recommended by over 100k members
Product Description:
Microsoft Teams is a tool that makes it easy for people to communicate with each other in a much collaborated, comprehensive and simplified way. Inside Microsoft Teams, the Search feature is crucial as it helps users find the information they need & complete tasks in reasonable amount of time
By the way, for everyone's reference, I've already downloaded Teams, checked it out a bit, and created two IDs. I had a chat to get the hang of it!
Approach:
#1: Clarification Questions & Assumptions:
1: When you hear "Search PM," does it mean I can make things better in both searching and moving around in Teams?
Interviewer: Yes
2: Microsoft Search team already has enough people and resources, and there are no problems with that aspect...
Interviewer: Yes
3: When we talk about customers, are we talking about the people who use the free version or the ones who pay for it? IMO, I want to concentrate on those who are paying for the services.
Interviewer: Okay
4: Are we thinking about both web and mobile?
Interviewer: You say
Response: MS Teams is widely used on both computers and phones, it makes sense to make sure it works well in both. So, we'll pay attention to both.
#2: Objective:
I always categorise users using AAAERRR (Awareness, Acquisition, Activation, etc.). We've already figured out awareness, acquisition, and activation for this. Now, we're discussing how to make our existing product better, and one key thing is getting more people to use its features.
I would like to people actively using and engaging with the features to make sure they find them valuable. So, paying attention to Engagement and keeping users interested in our product is crucial.
#3: User Groups and Persona: Teams for Individuals/Business
Active Users:
4: Are we thinking about both web and mobile?
Interviewer: You say
Response: MS Teams is widely used on both computers and phones, it makes sense to make sure it works well in both. So, we'll pay attention to both.
#2: Objective:
I always categorise users using AAAERRR (Awareness, Acquisition, Activation, etc.). We've already figured out awareness, acquisition, and activation for this. Now, we're discussing how to make our existing product better, and one key thing is getting more people to use its features.
I would like to people actively using and engaging with the features to make sure they find them valuable. So, paying attention to Engagement and keeping users interested in our product is crucial.
#3: User Groups and Persona: Teams for Individuals/Business
Active Users:
- Use Teams often (around 6-7 times a day) on both Desktop & Mobile
- Focus on improving efficiency and productivity through frequent use and enhance engagement & retention
- Form a primary communication mode and paid user
Casual Users:
- Don't use Teams frequently (around 1-2 times per week).
- Consider Teams as a secondary, not primary, communication method.
Passive Users:
- Generally not tech-savvy.
- May have tested Teams briefly or used it for a specific purpose.
Regarding Search, I will opt to address the needs of active users as active users are likely to use Search regularly for effective communication and collaboration
#4: User Journey:
- Head to the search bar.
- Search to find the person a user wants to chat/call, filtering out chats based on specific keywords, find the relevant info a user wants to see
- Press enter.
- Press enter.
- The needed information will pop up.
#5: Pain points:
Time-consuming Searches: Looking for documents or chats using keywords can be time-consuming because the user has to type everything.
Lot of steps involved to complete action for the user: Currently, there are 1-2 extra steps when searching for a chat using keywords or documents
#5: Pain points:
Time-consuming Searches: Looking for documents or chats using keywords can be time-consuming because the user has to type everything.
Lot of steps involved to complete action for the user: Currently, there are 1-2 extra steps when searching for a chat using keywords or documents
Lack of Guidance in Search Results
#6: Solutions:
.
6.1: AI Powered Voice Search: Right now, MS Teams Search doesn't have this feature, but if we add it, it can make the user more productive and save them from typing a lot. This would cover everything like text, documents, and chats based on keywords. For example, you could say, "Please open the document with the word 'Roadmap' shared by XX person." OR search for the chats after 13th November from XX person
#6: Solutions:
.
6.1: AI Powered Voice Search: Right now, MS Teams Search doesn't have this feature, but if we add it, it can make the user more productive and save them from typing a lot. This would cover everything like text, documents, and chats based on keywords. For example, you could say, "Please open the document with the word 'Roadmap' shared by XX person." OR search for the chats after 13th November from XX person
6.2: Real-time Translation: Integrate real-time language translation capabilities into the search function, allowing users to search for and understand content in multiple languages
6.3: Preview Feature in Search: Implement a search preview feature that provides a snippet or preview of the content.
Right now, when I type a keyword, I don't see a preview of chats with those keywords. For example, if I search for "roadmap," I have to type it, press enter, and then see the relevant chats. I suggest showing the relevant chats as I start typing to save time when looking for documents or understanding information. If there are a lot, show the top 5 using a current ranking algo, and then press enter for more results.
6.4: Lack of Guidance in search results:
6.4.1: Predictive Search: Leverage machine learning algorithms to predict a user's search intent and proactively provide relevant information before the user initiates a search. This could be based on historical data and context.
For instance, if I talked with someone (let's call them A), and we decided to set up a call, when I go to the Search Bar, it should remind me in recents to schedule a call with A because it's an important thing to do.
6.4.2: AI Powered Advice during Navigation: Similarly, during navigation with multiple results, if I want to schedule a reply, we can have a button saying "Reply with GPT," and GPT can suggest what to say next. Or, if having a dependency on sender, GPT can suggest what action to take.
#7: Prioritisation:
I'll use RICE Prioritization and feedback/opinion from relevant stakeholders to decide what's most important. Here's my final list based on my own thoughts and experience.
6.3: Preview Feature in Search: Implement a search preview feature that provides a snippet or preview of the content.
Right now, when I type a keyword, I don't see a preview of chats with those keywords. For example, if I search for "roadmap," I have to type it, press enter, and then see the relevant chats. I suggest showing the relevant chats as I start typing to save time when looking for documents or understanding information. If there are a lot, show the top 5 using a current ranking algo, and then press enter for more results.
6.4: Lack of Guidance in search results:
6.4.1: Predictive Search: Leverage machine learning algorithms to predict a user's search intent and proactively provide relevant information before the user initiates a search. This could be based on historical data and context.
For instance, if I talked with someone (let's call them A), and we decided to set up a call, when I go to the Search Bar, it should remind me in recents to schedule a call with A because it's an important thing to do.
6.4.2: AI Powered Advice during Navigation: Similarly, during navigation with multiple results, if I want to schedule a reply, we can have a button saying "Reply with GPT," and GPT can suggest what to say next. Or, if having a dependency on sender, GPT can suggest what action to take.
#7: Prioritisation:
I'll use RICE Prioritization and feedback/opinion from relevant stakeholders to decide what's most important. Here's my final list based on my own thoughts and experience.
Pain point | Solution | Prioritisation |
Time consuming searches | AI Powered voice Search | P0 |
Real time translation | P1 | |
Lot of steps involved to complete action for the user | Preview feature in Search | P0 |
Lack of guidance in Search Results | Predictive Search | P1 |
AI Powered Advice during Navigation | P1 |
#8: Trade Offs:
As of now, considering the position of AI: Predictive Search and AI Powered Advice during Navigation seems crucial. However, it's a lot of work because it involves complex machine learning and requires careful consideration of challenging use cases. So, for now, we're focusing on AI powered voice search and the Preview feature in Search because they give quick results with less work."
#9: Success Metrics: Listing the measures of top 4-5 success metrics for the most important features (P0).
Feature | Metrics |
AI Powered voice Search | 1: User adoption rate 2: Usage frequency 3: Task completion rate 4: Accuracy of recognition system 5: Time saved in Search |
Preview feature in Search | 1: Adoption Rate 2: Time saved in Search 3: User Engaged with Preview (CTR) 4: Reduction in Search Queries 5: User satisfaction surveys (CSAT) |
Please note: The metrics I mentioned earlier are like big-picture measures. We can dive deeper into specific use cases and technical details to get a better understanding
#10: Summary:
To sum up, my primary objectives are engagement and retention. I'll concentrate on users who actively use the product frequently. I'll prioritize the AI-powered voice search and the Preview feature in Search because they address issues like time-consuming searches and the need for a lot of steps to complete a desired action.
Top Microsoft interview questions
- How would you improve Outlook for the use case when people get overwhelmed by number of emails received after returning from a vacation?11 answers | 9.2k views
- Evaluate the upsides and downsides of building a super app — an app having all major B2C features including entertainment, e-commerce, food ordering, hotel booking, cab booking, chat, holiday planning, gaming, med ordering, service booking, etc.11 answers | 15.7k views
- Design a product for job seekers to create resumes and find the best matching jobs easily and quickly.11 answers | 11.7k views
- See Microsoft PM Interview Questions
Top Product Improvement interview questions
- What is your favorite product? Why?89 answers | 263k views
- How would you improve YouTube?29 answers | 81.3k views
- How can you improve Facebook Stories?22 answers | 45.5k views
- See Product Improvement PM Interview Questions
Top Microsoft interview questions
- Design Netflix for Senior Citizens (Goal: Increase engagement time).10 answers | 10.9k views
- How would you design a car sharing platform like Uber for disabled people?9 answers | 11.3k views
- How many balls does it take to fill a 16x16 ft room?9 answers | 19.5k views
- See Microsoft PM Interview Questions
Top Product Improvement interview questions
- How would you improve Facebook Birthdays?21 answers | 25.8k views
- How would you improve user engagement on WhatsApp?18 answers | 25.1k views
- How would you improve Amazon?14 answers | 35k views
- See Product Improvement PM Interview Questions