post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Artificial Intelligence (AI) & Machine Learning (ML)

Microsoft lays off 3% of workforce while renogiating partnership with OpenAI

Podcast

How to build the right product culture during transformation – Joca Torres (Product Consultant)

B2B product management

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Context, intent, change, purpose, constraints – a model for communicating requirements

5 difficult conversations and how to have them

DoorDash eats Deliveroo while OpenAI makes its biggest buy: This week’s news roundup

Why great product managers think like therapists

Tools and techniques to scale product teams – Charlotte King (Lead Product Manager, eBay)

Eira is an editor for Mind the Product. She's been a business journalist, editor, and copywriter for longer than she cares to think about.

Eira Hayward

In this #mtpcon San Francisco 2023 keynote, <a href="https://www.linkedin.com/in/tomersharon" target="_blank" rel="noopener">Tomer Sharon,</a> Co-founder and CXO at workplace experience platform <a href="https://www.anywell.com/" target="_blank" rel="noopener">anywell</a>, talks about measuring the user experience and the advantages of high-level metrics. Watch the video in full of read on for his key points. 
<hr />
He starts by asking the audience to rate the conference so far and wonders what variables would affect their answers &#8211; the time, the temperature, their past experience might all come into play.
Tomer then tells a story from his time working on the Google Search team more than 10 years ago. The team loved looking at two metrics, long and short clicks. The team thought that long clicks &#8211; where a user clicked on a link and stayed there for a long time &#8211; were good, because the user had gone to the right place. They thought short clicks &#8211; where the user clicked back and forth through many links  &#8211; were bad. It was only when they watched users in a lab that they realised this wasn’t the case. “It was just that the internet was a mess and they couldn’t find what they were looking for,” Tomer says.
<h3>Experience metrics</h3>
Experience metrics are quantitative scores for important and actionable phenomena related to using products and services, Tomer says.
He splits a product launch into four stages of a cycle &#8211; someone has the idea, you build it, launch it and learn from it.
<ul>
<li>Tactical research happens from the time we learn something till we have an idea</li>
<li>Strategic research should happen all the time. It looks into motivations and needs</li>
<li>Metrics come into their own after product launch, when we want to learn</li>
</ul>
The biggest challenge that a team has is understanding the answer to the question “how are we doing?”, Tomer says. Dashboards aren’t clear, and there’s no clear answer to this question and so teams focus on detailed metrics rather than high-level metrics. “People strive to solve the problems that humans have but they’re not looking at the data that helps them to solve these problems,” he says.
<h3>Principles of high-level metrics</h3>
Tomer then talks about some of the principles of high-level metrics and overall versus specific metrics. “I’d argue that coming up with a number for an overall satisfaction score should not come from a question about the overall experience.It should come from a series of questions about the most important components which are then aggregated into one score.”
You should also focus on behaviour rather than opinion, because our opinions are very unstable. “Satisfaction is extremely biased and there are other, more telling, metrics that show the actual behaviour,” Tomer says.
Tomer moves on to the Google Heart framework of metrics (happiness, engagement, adoption, retention, task success), omitting the last metric of task success because it’s more relevant to tactical research. Happiness is opinion, he explains, but the other three metrics are behavioural.
One of the biggest advantages of high-level metrics is that you can very quickly understand what’s going on. They can be extremely useful in creating OKRs, Tomer says, and for understanding the effect of change.
<h3>Want to turn the learning from this talk into action?</h3>
Our exciting #mtpcon San Francisco 2023 <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Keynote Kit</a> brings you all of the insights from our San Francisco keynote talks plus additional helpful discussion points and thought starters so you can easily translate the insights into actions – perfect for making effective improvements to your role, team, and product. Plus, get an email notification when each talk is published! <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Sign up now</a>.

core/freeform

Product Management Conference

Why emotional connection drives successful products: Nesrine Changuel at #mtpcon London (Google, Spotify, Microsoft)

Product teams in flux – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Berlin’s leading companies – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Amsterdam’s leading companies – Pendomonium+#mtpcon roadshow: Amsterdam

Product teams in flux – Pendomonium+#mtpcon roadshow: London

AI in practice at London’s leading companies – Pendomonium+#mtpcon roadshow: London

What’s next for product management in 2024? Nichole Mace (SVP Product and User Experience, Pendo)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Perspectives from an unconventional CPO – Yuelin Li (CPO, Onfido)

The future of product management – Trisha Price (CPO, Pendo)

Measuring the user experience by Tomer Sharon

ProductTank Pune

ProductTank Hyderabad

ProductTank Valencia

ProductTank Auckland

ProductTank Helsinki

ProductTank Barcelona

ProductTank Lomé

ProductTank Wellington

ProductTank San Diego

ProductTank Canberra

ProductTank Perth

ProductTank Hong Kong

ProductTank Bangkok

ProductTank Doha

ProductTank Tel Aviv-Yafo

ProductTank Baku

ProductTank Reston

ProductTank Raleigh

ProductTank Charlotte

ProductTank Washington

ProductTank Richmond

ProductTank Cluj-Napoca

ProductTank Zagreb

ProductTank Amsterdam

ProductTank Edinburgh

ProductTank Paris

ProductTank Hamburg

ProductTank München

ProductTank Manchester

ProductTank Bristol

ProductTank Oxford

ProductTank Madrid

ProductTank Des Moines

ProductTank Dallas

ProductTank Portland

ProductTank Curitiba

ProductTank Chicago

ProductTank Austin

ProductTank Philadelphia

ProductTank Montevideo

ProductTank São Paulo

ProductTank Los Angeles

ProductTank Gdansk

ProductTank Stuttgart

ProductTank Pittsburgh

ProductTank Bangalore

ProductTank Chennai

ProductTank Mumbai

ProductTank Fribourg

ProductTank Norwich

ProductTank Zürich

ProductTank Newcastle Upon Tyne

ProductTank Jacksonville

ProductTank Florianópolis

ProductTank Tallinn

ProductTank Denver

ProductTank San Francisco

ProductTank Sheffield

ProductTank Tokyo

ProductTank Valletta

ProductTank Bologna

ProductTank Vancouver

ProductTank Milano

ProductTank Columbus

ProductTank Belfast

ProductTank Montréal

ProductTank Seattle

ProductTank Lausanne

Product Management Foundations BST

Product Management Foundations ET

ProductTank Reading

ProductTank Bielefeld

Communication & Alignment BST

Communication & Alignment ET

ProductTank Frankfurt

ProductTank Bonn