post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Artificial Intelligence (AI) & Machine Learning (ML)

Microsoft lays off 3% of workforce while renogiating partnership with OpenAI

Podcast

How to build the right product culture during transformation – Joca Torres (Product Consultant)

B2B product management

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Context, intent, change, purpose, constraints – a model for communicating requirements

5 difficult conversations and how to have them

DoorDash eats Deliveroo while OpenAI makes its biggest buy: This week’s news roundup

Why great product managers think like therapists

Tools and techniques to scale product teams – Charlotte King (Lead Product Manager, eBay)

Eira is an editor for Mind the Product. She's been a business journalist, editor, and copywriter for longer than she cares to think about.

Eira Hayward

<p>If you’re a product manager, it’s not enough simply to understand metrics, you also need to know how to pick the right ones. And it’s not easy &#8211; <a href="https://www.linkedin.com/in/scottgraffius/" target="_blank" rel="noopener">Scott Graffius</a> summed up this problem very well in his book<a href="https://www.amazon.co.uk/Agile-Scrum-Step-Step-Instructions/dp/1533370249" target="_blank" rel="noopener"> Agile Scrum</a>, saying: “If you don&#8217;t collect any metrics, you&#8217;re flying blind. If you collect and focus on too many, they may be obstructing your field of view.”</p>
<p>We review advice from product leaders to examine the factors you need to consider when evaluating your product metrics.</p>
<h3>Are they actionable?</h3>
<p>As product leader <a href="https://www.linkedin.com/in/johnpcutler/" target="_blank" rel="noopener">John Cutler</a> points out in this MTP panel discussion, <a href="https://www.mindtheproduct.com/metrics-that-matter-live-panel/" target="_blank" rel="noopener">How to define the metrics that matter</a>, metrics help you to reduce uncertainty in an area where this is valuable.</p>
<p>Metrics should reflect a company’s strategy, so clear metrics are a good indicator that a company knows what it’s doing. By the same token if the metric doesn’t solve a problem or drive a strategy forward then it’s a vanity metric. As John Cutler also observes, vanity metrics can look great superficially but they don’t inform strategy and help anyone to make decisions. They may give the impression of improvements but don’t help you understand performance. For example, knowing the number of new users gained per day might be encouraging but it doesn’t help with decision-making.</p>
<p>This<a href="https://www.productplan.com/glossary/vanity-metrics/" target="_blank" rel="noopener"> ProductPlan article</a> gives a few pointers on what to look for in an actionable metric: look at the business decision the metric helps you to make, whether you can intentionally reproduce the results and whether the data is a real reflection of the truth.</p>
<h3>Are you collecting everything?</h3>
<p>A classic mistake is to collect so much data that a team becomes overwhelmed by the noise of it all and doesn’t focus on the things that matter. And as Mind the Product Managing Director Emily Tate observes, “the data will rarely just magically surface some insight that you never would have thought to look for”.</p>
<p>It’s better practice to work backwards from the outcome you expect from any change you make, and to know what action you will take when a metric moves a certain way. Then you can limit what you measure. It’s also easier to make decisions and correlate data when you limit what you measure, so you need a strategy to query your data for actionable insights.</p>
<h3>Can you use a framework?</h3>
<p>There are several frameworks to give you a sensible plan on how to interrogate your data. This Mind the Product post from 2018, <a href="https://www.mindtheproduct.com/why-do-you-need-to-rethink-your-analytics-strategy/" target="_blank" rel="noopener">why do you need to rethink your analytics strategy?</a>, offers guidance on how to ask the right questions of your data rather than look for the right answers.</p>
<p>This post from vendor Userpilot, <a href="https://userpilot.com/blog/product-metrics-framework/" target="_blank" rel="noopener">Product managers’ guide for selecting the right product metrics framework</a> gives a handy run-through of the many frameworks available, including Pirate, North Star and OKRs. This post from vendor Amplitude, <a href="https://amplitude.com/blog/product-north-star-metric" target="_blank" rel="noopener">every product needs a north star metric: here’s how to find yours</a>, is also a great guide to how to define your north star metric and use it to drive long-term strategy and growth. And this MTP post, <a href="https://www.mindtheproduct.com/measuring-the-right-north-star-metric/" target="_blank" rel="noopener">Measuring the right North Star metric,</a> from product management and discovery coach Sebastian Straube, gives some great examples of exemplary north star metrics.</p>
<h3>What types of metrics do you need to track?</h3>
<p>A product team needs to track different types of metrics. Operational metrics, such as the number of active users, serve to show that the business and product are not going in the wrong direction and need to be tracked even if no one actively makes decisions about them.</p>
<p>You should track a mix of leading and lagging indicators to help predict future performance. This MTP article from earlier this year, <a href="https://www.mindtheproduct.com/are-you-tracking-the-right-product-metrics/" target="_blank" rel="noopener">Are you tracking the right product metrics?</a> gives plenty of pointers on choosing metrics, and talks to some experienced product leaders about their journeys to find the right metrics to track.</p>
<p>Mind the Product’s training workshop <a href="https://www.mindtheproduct.com/product-management-training/public-workshops/product-metrics-workshop/" target="_blank" rel="noopener">Metrics for Product Managers</a> also focuses on how you define a North Star metric and then craft an appropriate metrics plan.</p>
<h3>Other considerations</h3>
<p>Remember there won’t always be a right or a wrong answer, and metrics don’t always provide clarity. Because metrics are numeric, this is something we often forget. What you should also remember is that metrics must ultimately serve or be reflective of your users and their behaviour.</p>
<p>Crafting metrics is a practice. It’s not something that is necessarily perfected easily, and it’s an ongoing process, not a one-time effort. A product manager needs buy-in from stakeholders, and the time and dedication to review and renew metrics with a regular cadence.</p>
<h3>Further resources</h3>
<p>If you’re completely new to product management and analytics, then this evergreen article from Mind the Product, <a href="https://www.mindtheproduct.com/everything-a-product-manager-needs-to-know-about-analytics/" target="_blank" rel="noopener">Everything a product manager needs to know about analytics</a>, is a good place to start. It drills down into the concepts behind analytics and offers advice on how to plan their implementation.</p>
<p>You’ll also find a comprehensive range of talks, articles and advice on all things analytics from Mind the Product here: <a href="https://www.mindtheproduct.com/category/product-management-metrics-and-kpis/" target="_blank" rel="noopener">Product Management Metrics and KPIs.</a></p>


core/freeform

Product Analytics

Strategies for developing data products with Sisense

Product analytics vs embedded analytics – why you need both with Insightssoftware

Why product managers should not be data-driven by Jens-Fabian Goetzmann

Placing product bets on your roadmap by Indicative

When A/B Tests Aren’t Enough, By Scott Castle

Growth Hacking for Product Managers by Chris Long

How can we Build Human-Centred Products by Kim Goodwin

Quick read: Best practices for picking product metrics

ProductTank Pune

ProductTank Hyderabad

ProductTank Valencia

ProductTank Auckland

ProductTank Helsinki

ProductTank Barcelona

ProductTank Lomé

ProductTank Wellington

ProductTank San Diego

ProductTank Canberra

ProductTank Perth

ProductTank Hong Kong

ProductTank Bangkok

ProductTank Doha

ProductTank Tel Aviv-Yafo

ProductTank Baku

ProductTank Reston

ProductTank Raleigh

ProductTank Charlotte

ProductTank Washington

ProductTank Richmond

ProductTank Cluj-Napoca

ProductTank Zagreb

ProductTank Amsterdam

ProductTank Edinburgh

ProductTank Paris

ProductTank Hamburg

ProductTank München

ProductTank Manchester

ProductTank Bristol

ProductTank Oxford

ProductTank Madrid

ProductTank Des Moines

ProductTank Dallas

ProductTank Portland

ProductTank Curitiba

ProductTank Chicago

ProductTank Austin

ProductTank Philadelphia

ProductTank Montevideo

ProductTank São Paulo

ProductTank Los Angeles

ProductTank Gdansk

ProductTank Stuttgart

ProductTank Pittsburgh

ProductTank Bangalore

ProductTank Chennai

ProductTank Mumbai

ProductTank Fribourg

ProductTank Norwich

ProductTank Zürich

ProductTank Newcastle Upon Tyne

ProductTank Jacksonville

ProductTank Florianópolis

ProductTank Tallinn

ProductTank Denver

ProductTank San Francisco

ProductTank Sheffield

ProductTank Tokyo

ProductTank Valletta

ProductTank Bologna

ProductTank Vancouver

ProductTank Milano

ProductTank Columbus

ProductTank Belfast

ProductTank Montréal

ProductTank Seattle

ProductTank Lausanne

Product Management Foundations BST

Product Management Foundations ET

ProductTank Reading

ProductTank Bielefeld

Communication & Alignment BST

Communication & Alignment ET

ProductTank Frankfurt

ProductTank Bonn

Quick read: Best practices for picking product metrics

Eira Hayward

Read more