post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Artificial Intelligence (AI) & Machine Learning (ML)

Microsoft lays off 3% of workforce while renogiating partnership with OpenAI

Podcast

How to build the right product culture during transformation – Joca Torres (Product Consultant)

B2B product management

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Context, intent, change, purpose, constraints – a model for communicating requirements

5 difficult conversations and how to have them

DoorDash eats Deliveroo while OpenAI makes its biggest buy: This week’s news roundup

Why great product managers think like therapists

Tools and techniques to scale product teams – Charlotte King (Lead Product Manager, eBay)

Louron serves as the Editor at Mind the Product, bringing nearly a decade of experience in editorial positions across business and technology publications. For any editorial inquiries, you can connect with him on LinkedIn or Twitter.

Louron Pratt

<a href="https://www.meetup.com/producttank-bellevue/">Product Tank Bellevue</a> recently hosted a live-streamed session offering a glimpse into the world of <a href="https://www.pendo.io/resources/the-data-driven-playbook-for-product-led-teams/?&amp;utm_source=mtp&amp;utm_medium=display&amp;utm_campaign=mtp-resources-data-playbook-q3" target="_blank" rel="noopener">data-centric</a> product management. The event, facilitated by ProductTank organisers <a href="https://www.linkedin.com/in/cortney-jacobsen-148b721/">Cortney Jacobsen</a> and <a href="https://www.linkedin.com/in/leistephenwang/">Stephen Wang</a>, featured <a href="https://www.linkedin.com/in/jmorra/">John Mora</a>, Chief AI Officer at Zefr. Watch the video in full, or read on for the key points discussed.
<iframe loading="lazy" title="Product Tank Bellevue: Leading Data-Centric Product Managers" src="https://www.youtube.com/embed/no_6LNuH1jI" width="869" height="489" frameborder="0" allowfullscreen="allowfullscreen"></iframe>
Jon has spent over 12 years leading and building data products. He shared some key learnings from leading a data team at dating app eHarmony.
From 2013-2016, eHarmony had a robust machine-learning infrastructure. Jon explained how its matching system was based on three metrics: Compatibility matching, affinity matching, and match distribution. “This system was created through linear models by a group of psychologists we employed,” he said.
<img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/02/ab832d5c-f184-4d22-adb4-23c31419785a_Screenshot202024-02-2020at2012.48.48.jpg" />
In affinity matching, which Jon worked in. The team defined success as 7-day, 2-way communication. This means that within 7 days, if there were at least one message back and forth, this would be considered a successful affinity match. Finally, Match Distribution was introduced to ensure that everyone using the app would at least get a few matches.
<h2>Challenges and problems</h2>
Jon explained how this matching system had its challenges. For example, just because there was a lack of communication between a match, it didn’t necessarily mean that there was a lack of interest. A user might have just been busy during the 7 days.
When dealing with user feedback, Jon explained that “the number one complaint we got from the Customer Success team was that he was not as tall as he said he was. The number two complaint was, ‘why did you match me with this person?’” He said how the team always dug in hard to change user issues, but they were never deemed ‘good enough’. “We were trying to solve the most complex concept in the world, human love. People will always find holes,” he says.
Currently at brand advertising company Zefr, Jon’s biggest challenge is that ground truth is difficult to trust. Labelling products is a tedious task and difficult to do well. Training and developing new models is a weekly ops requirement, “if we’re not performing these weekly, then we’re losing out on insights in the world,”
<h2>How to manage data teams</h2>
When managing<a href="https://www.pendo.io/resources/how-to-become-a-data-driven-product-manager/?&amp;utm_source=mtp&amp;utm_medium=display&amp;utm_campaign=mtp-data-pm-q3" target="_blank" rel="noopener"> data-centric</a> teams, Jon explained that the role of the product manager is slightly different to a more customer-facing product role. “They have to love the technical details on the interfaces and must produce useful documentation,” he said. Jon advocated an agile approach with two-week sprints, ensuring consistent and well-documented results—this system has worked well for the data team at Zefr.
He also shared valuable resources for product managers to learn about data, and understand how to empathise with data teams, including:
<ul>
<li><a href="https://paperswithcode.com/">Papers With Code</a></li>
<li><a href="https://huggingface.co/">Hugging Face </a></li>
<li><a href="https://towardsdatascience.com/">Towardsdatascience.com </a></li>
</ul>
Additionally, Jon explained that data-centric product managers should be able to easily partner with the data engineering team, understand how data ties to customer needs, and have a strong <a href="https://www.mindtheproduct.com/the-importance-of-empathy-by-jack-sheppard/" target="_blank" rel="noopener">empathy</a> for the customer. “Teams will always go deep on the data, but can often lose sight of the customer,” Jon said, “it’s important for the product manager to always ask ‘does this make sense for the user?’ This is a fundamental value for any product manager, regardless of whether they are working with data teams or not,”
Finally, the product manager has to be able to tell great stories with data while also knowing when to trade off research and development. Getting into the technical weeds is imperative.
<img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/02/84d0aeba-60b4-404b-bfdc-977bd8f9769d_Screenshot202024-02-2020at2013.27.05.jpg" />
<img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/02/0b53acd5-fe7f-40ab-9ce1-658b3276204d_Screenshot202024-02-2020at2013.35.01.jpg" />
<h2>Employee personas</h2>
To help the audience better understand a standard data team hierarchy, Jon shared a helpful pyramid explaining the key roles in a data team.
<ul>
<li>Data engineers: These are people who will live and breathe data sources and databases.</li>
<li>ML Engineer: This is the glue between the produced data and the ML algorithms. A lot of the tools around ML have become approachable. They understand the tool and LLMs like Chat GPT</li>
<li>Data Scientists: Finally, the data scientists are essentially researchers at heart. One of the hardest things for the product manager is ensuring that data scientists are balancing research while also being focused on business outcomes.</li>
</ul>
How we organise and manage teams is the way to build effective products. Jon notes Conway’s Law. Under this law, everyone can talk to everyone, has a mission, and all of the complexities are fed to the application whilst not being surfaced to the user.
<img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/02/cb3ffcc8-78c9-498e-9e3a-93fe0be95deb_Screenshot202024-02-2020at2014.56.46.png" />
<img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/02/dc578af1-3930-4ce0-bfe5-d0eba789ed54_Screenshot202024-02-2020at2013.16.45.png" />
<h2>Working with LLMs</h2>
Large language models are everywhere, Jon explained. “LLMs aren’t new for data scientists. We’ve been thinking about this for ten years,” he said, “When we think about LLMs in product management, I’m nervous because we are at the top of the hype cycle,” he explained to think about LLMs product in a user-centric way is key to surviving. LLMs can’t do everything &#8211; they can’t solve problems. Treat them as a tool, not as a solution, he added.
“The data field is moving faster than ever. Please, please, please try out LLMs, but don’t live and die by them,”
<a href="https://www.mindtheproduct.com/producttank-about/">ProductTanks</a> are informal meetups, created by Mind the Product, to bring local product people together and to enable speakers to share amazing product insights. Find your local ProductTank meetup to enjoy incredible product talks and connect with new product people – absolutely free! Use our map to get started. <a href="https://www.mindtheproduct.com/producttank/">Take me to the map</a>

core/freeform

How Booking.com tackled a data quality crisis: Nimit Bhardwaj (Data Product Manager) – Product Unplugged

How to lead data-centric product teams: Jon Mora (Chief AI Officer, Zefr)

How to be a better data-driven product manager

User insights for product decisions by Cris Valerio

Data scaling for startups by Crystal Widjaja

Make Better Product Decisions by Using Quantitative and Qualitative Data, by Brian Tran