post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

mission statement

Deep dive: Crafting your product vision and mission

Podcast

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Join us at #mtpcon London in 2025 – mark your calendars

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

5 ways to invent and simplify as an AI/ML product manager

Why teams often struggle with OKRs: A conversation with Jeff Gothelf

Building your own user experience and software stack: This week’s product news

Adam is a Product Management expert, speaker, coach, and the creator of the Survival Metrics framework for product teams. You can see his Daily Product Insights on: Twitter @HonorableATpdm, Instagram Honorableat_PDM, and get biweekly, free product coaching on Substack via The Adam Thomas Newsletter .

Product Management expert, speaker, coach

Adam Thomas

Hiring in product is broken, and those hypothetical product questions you get asked in interviews are just the tip of the iceberg.
“Describe a coffee cup.”
No, you’re not in the middle of a therapy session, you’re in a product manager interview, and a bad one at that.
If you can, you should get up and walk out, because your interviewer’s bias is about to count against you.
Yes, bias.
These types of questions are great if you look, sound, and have “the resume” the interviewer dreams about when they put up the job posting (none of these things are explicit. It would get them sued).
But because they can’t be explicit about what they want (anti-discrimination legislation and all that) here you are, describing a coffee cup, and unintentionally running directly into a process that is full of bias.
Sorry to break it to you, but if you don’t look like you fit on the company’s “about us” page, you’re in a world of trouble.
<h2>How did we get here?</h2>
Enter the product hypothetical &#8211; for a long time, companies have been using interview questions like “how many matches could you fit inside of an airplane” or “how many gas stations are in the country” as a way to understand how someone thinks.
But do these questions really help you to understand how product people think? I posit that they don’t. Instead, they land us in a world where bias wins and rational thinking loses.
What do I mean by that? Let’s ask the world of behavioral science.
<h2>Behavioral Science isn’t new</h2>
Behavioral science teaches us about our mind’s proclivity to lean towards bias, specifically cognitive bias.
In fact, we’re cognitive bias machines. I learned this while reading about behavioral science from two of its foremost experts, <a href="https://www.newyorker.com/books/page-turner/the-two-friends-who-changed-how-we-think-about-how-we-think" target="_blank" rel="”noopener” noopener noreferrer">Daniel Kahneman and Amos Tversky</a>. The pair spent their lives trying to understand the WHY behind our behavior, and for their efforts, they became two of the world&#8217;s most cited academics.
Kahneman&#8217;s seminal work, <a href="https://www.amazon.co.uk/Thinking-Fast-Slow-Daniel-Kahneman/dp/0141033576" target="_blank" rel="”noopener” noopener noreferrer">Thinking Fast and Slow</a>, talks about our system 1 &#8211; intuition, and system 2 &#8211; rational thought. Most importantly the book shows us that our intuition is a hotbed of cognitive bias, one that can be controlled by almost anything &#8211; from how much we’ve eaten in the morning to the last argument we had with our spouse. Do you want your choice of breakfast to determine the next person on your team? Relying on intuition means it could play an important role.
<h2>Back to bias</h2>
The Kahneman and Tversky research points to system 1 as being susceptible to bias.
Most product hypotheticals have no guideline, no rubric, and rely on the “intuition” of the person giving the hypothetical to determine what happens next.
Ask yourself, when you&#8217;ve seen a product hypothetical with clear criteria? And by this, I mean a situation in which the criteria have been clear for both the interviewer and the person being interviewed.
While the person on the other side might be trying their hardest to work out a complex system, the interviewer is just listening, usually passively. With no rubric, no grading structure &#8211; they end up at the whim of their system 1 thinking.
<h2>What happens as a result?</h2>
Unfortunately, in this situation, the interviewer is more likely to play heuristic bingo (a term I’ve created that describes when we let our bias control our decisions).
Heuristic bingo is a good thing when deciding where you want to eat for lunch, but when it comes to hiring, it leads to disastrous consequences. The interview process becomes less about skills, experience and know-how and more about what we expect people to look and sound like.
For folks like me, who aren’t white from privilege, it means you end up a casualty of the process, no matter what your skills are. This plays itself out during the hypothetical section of interviews where the interviewer relies more on whether things &#8216;feel&#8217; correct rather than if they are interesting or match criteria.
If that person says something novel, it is discounted. This is particularly insidious in product management because most of the work is contextual, and a best practice at Facebook may (actually, probably) mean absolutely nothing at your company.
<h2>How do we avoid bias?</h2>
Let’s shift to system 2, our rational thought, which is less susceptible to cognitive bias.
One of the easy ways to get into system 2 thinking is to have a long conversation about someone&#8217;s life. The good news is that interviews already have a vehicle for such things &#8211; it’s our experience.
People have no problem telling stories about how they did something. The important thing to remember is that you’ll need to really dig in, as an interviewer, to know what “something” you are looking for. Your questions are important.
This is no different from trying to solve a problem for a product you own. This is the time to ask questions and get context around how this person&#8217;s experience helps your company to solve that problem.
<h2>It&#8217;s time to talk to people more</h2>
Our brains are built for stories, and in hiring, we need to take full advantage of that. So instead of asking people to create, just ask them to recall.
Talking to people and asking them to recall will help you to uncover their stories, through which you can learn about what they&#8217;ve done.
Their stories will be filled with details and these details are enough to see if someone is being honest. They also give you room to ask follow-up questions to get to the bottom of what you need. Write them down so you can check them against your criteria and understand what you&#8217;re looking for.
For extra points, recording and rewatching the conversation (especially if someone is further along in the hiring process) can give you, the interviewer, more insight into this person&#8217;s experiences. It also gives your &#8216;system 2&#8217; enough time to think about the conversation.
<figure id="attachment_20408" aria-describedby="caption-attachment-20408" style="width: 824px" class="wp-caption aligncenter"><img loading="lazy" decoding="async" class="wp-image-20408" src="https://www.mindtheproduct.com/wp-content/uploads/2020/06/diverse-business-people-shutterstock_1375900421-300x169.jpg" alt="" width="824" height="464" srcset="https://www.mindtheproduct.com/wp-content/uploads/2020/06/diverse-business-people-shutterstock_1375900421-300x169.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2020/06/diverse-business-people-shutterstock_1375900421-768x432.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2020/06/diverse-business-people-shutterstock_1375900421-1024x576.jpg 1024w, https://www.mindtheproduct.com/wp-content/uploads/2020/06/diverse-business-people-shutterstock_1375900421-285x160.jpg 285w, https://www.mindtheproduct.com/wp-content/uploads/2020/06/diverse-business-people-shutterstock_1375900421-570x320.jpg 570w" sizes="(max-width: 824px) 100vw, 824px" /><figcaption id="caption-attachment-20408" class="wp-caption-text">Don&#8217;t ask people to create, ask them to recall (Image: Shutterstock)</figcaption></figure>
<h2>Hiring is broken</h2>
Let’s be clear — hiring in product is broken. In fact, many tech companies are failing outright when it comes to hiring equitably, despite the <a href="https://docs.google.com/spreadsheets/d/1OZx-_tm3PPyx6-ZJAST1xxOJRfn7KfYDjDT6JedrTfs/htmlview?usp=sharing&amp;pru=AAABcqmP-Jc*maMNErlNK31Yp_84F68Wbg" target="_blank" rel="”noopener” noopener noreferrer">statements</a> many have made in response to recent police brutality. These statements have been highlighted in a database published by <a href="http://tpinsights.com/" target="_blank" rel="”noopener” noopener noreferrer">The Plug</a>, in response to which, The Plug founder, <a href="https://tpinsights.com/2020/05/31/twilio-box-spotify-and-other-tech-ceos-speak-out-against-racism-and-police-brutality-others-stay-silent/" target="_blank" rel="”noopener” noopener noreferrer">Sherrell Dorsey, has reported</a> that at the majority of companies in the database so far, less than 4% of employees are black.
Talking about product hypotheticals is, therefore, only the tip of the iceberg, as there are systemic injustices that lead to inequality everywhere, as recent events clearly illustrate. If we’re to make a better world, we need to work for it.
With that said, getting rid of hypotheticals now can give you the space to focus on a more equitable hiring system by listening more to candidates and asking them about the problems that they are dealing with.
That is how we solve problems.
<a href="https://www.mindtheproduct.com/category/diversity-and-inclusion/" target="_blank" rel="noopener">Discover more content on Diversity and Inclusion. </a>

core/freeform

Making product magic with cross-functional collaboration by Ebi Atawodi

10 years Wiser: Lessons learned from scaling Wise by Nilan Peiris

Breaking down misconceptions to create healthier teams by Adrian Howard

Creating courageous product teams with Yi-Wei Ang

Mastering perspective – zoom in, zoom out as a product leader by Navya Rehani Gupta

Bias in interviews and why hiring in product is broken

Adam Thomas

Read more

Comments