post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

How to measure impact in Product Operations

Artificial intelligence (AI)

How to navigate the explosion of AI tools aimed at product managers

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why self-care is your secret weapon as a product manager

What if pricing was your best feature?

Navigating the workplace as a young product manager

Klarna goes on recruitment drive after ditching AI-first policy

How Stack Overflow is competing with AI – Jody Bailey (CPTO, Stack Overflow)

Eira is an editor for Mind the Product. She's been a business journalist, editor, and copywriter for longer than she cares to think about.

Eira Hayward

In this #mtpcon San Francisco 2023 keynote, <a href="https://www.linkedin.com/in/tomersharon" target="_blank" rel="noopener">Tomer Sharon,</a> Co-founder and CXO at workplace experience platform <a href="https://www.anywell.com/" target="_blank" rel="noopener">anywell</a>, talks about measuring the user experience and the advantages of high-level metrics. Watch the video in full of read on for his key points. 
<hr />
He starts by asking the audience to rate the conference so far and wonders what variables would affect their answers &#8211; the time, the temperature, their past experience might all come into play.
Tomer then tells a story from his time working on the Google Search team more than 10 years ago. The team loved looking at two metrics, long and short clicks. The team thought that long clicks &#8211; where a user clicked on a link and stayed there for a long time &#8211; were good, because the user had gone to the right place. They thought short clicks &#8211; where the user clicked back and forth through many links  &#8211; were bad. It was only when they watched users in a lab that they realised this wasn’t the case. “It was just that the internet was a mess and they couldn’t find what they were looking for,” Tomer says.
<h3>Experience metrics</h3>
Experience metrics are quantitative scores for important and actionable phenomena related to using products and services, Tomer says.
He splits a product launch into four stages of a cycle &#8211; someone has the idea, you build it, launch it and learn from it.
<ul>
<li>Tactical research happens from the time we learn something till we have an idea</li>
<li>Strategic research should happen all the time. It looks into motivations and needs</li>
<li>Metrics come into their own after product launch, when we want to learn</li>
</ul>
The biggest challenge that a team has is understanding the answer to the question “how are we doing?”, Tomer says. Dashboards aren’t clear, and there’s no clear answer to this question and so teams focus on detailed metrics rather than high-level metrics. “People strive to solve the problems that humans have but they’re not looking at the data that helps them to solve these problems,” he says.
<h3>Principles of high-level metrics</h3>
Tomer then talks about some of the principles of high-level metrics and overall versus specific metrics. “I’d argue that coming up with a number for an overall satisfaction score should not come from a question about the overall experience.It should come from a series of questions about the most important components which are then aggregated into one score.”
You should also focus on behaviour rather than opinion, because our opinions are very unstable. “Satisfaction is extremely biased and there are other, more telling, metrics that show the actual behaviour,” Tomer says.
Tomer moves on to the Google Heart framework of metrics (happiness, engagement, adoption, retention, task success), omitting the last metric of task success because it’s more relevant to tactical research. Happiness is opinion, he explains, but the other three metrics are behavioural.
One of the biggest advantages of high-level metrics is that you can very quickly understand what’s going on. They can be extremely useful in creating OKRs, Tomer says, and for understanding the effect of change.
<h3>Want to turn the learning from this talk into action?</h3>
Our exciting #mtpcon San Francisco 2023 <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Keynote Kit</a> brings you all of the insights from our San Francisco keynote talks plus additional helpful discussion points and thought starters so you can easily translate the insights into actions – perfect for making effective improvements to your role, team, and product. Plus, get an email notification when each talk is published! <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Sign up now</a>.

core/freeform

Product Management Conference

Why emotional connection drives successful products: Nesrine Changuel at #mtpcon London (Google, Spotify, Microsoft)

Product teams in flux – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Berlin’s leading companies – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Amsterdam’s leading companies – Pendomonium+#mtpcon roadshow: Amsterdam

Product teams in flux – Pendomonium+#mtpcon roadshow: London

AI in practice at London’s leading companies – Pendomonium+#mtpcon roadshow: London

What’s next for product management in 2024? Nichole Mace (SVP Product and User Experience, Pendo)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Perspectives from an unconventional CPO – Yuelin Li (CPO, Onfido)

The future of product management – Trisha Price (CPO, Pendo)

Measuring the user experience by Tomer Sharon

ProductTank Stuttgart

ProductTank Bratislava

ProductTank Stockholm

ProductTank Bonn

ProductTank Milano

ProductTank Madrid

ProductTank Columbus

ProductTank Sofia

ProductTank Belfast

ProductTank Toronto

ProductTank Bangkok

ProductTank Kraków

ProductTank Barcelona

ProductTank Montréal

ProductTank Chicago

ProductTank Seattle

ProductTank Linköping

ProductTank Rotterdam

ProductTank Cardiff

ProductTank San Francisco

ProductTank Auckland

ProductTank Newcastle Upon Tyne

ProductTank Abu Dhabi

ProductTank Lausanne

ProductTank Ljubljana

ProductTank Valencia

ProductTank Luxembourg

Product Management Foundations BST

Product Management Foundations ET

ProductTank Edinburgh

ProductTank Des Moines

ProductTank Philadelphia

ProductTank Reston

ProductTank Dubai

ProductTank Prague

ProductTank Reading

ProductTank Jacksonville

ProductTank Rio de Janeiro

ProductTank Atlanta

ProductTank Los Angeles

ProductTank Bielefeld

ProductTank Köln

Communication & Alignment BST

Communication & Alignment ET

ProductTank Paris

ProductTank Frankfurt

ProductTank Milton Keynes

ProductTank Norwich

ProductTank Pittsburgh

ProductTank Manchester

ProductTank Exeter

ProductTank Malmö