post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

mission statement

Deep dive: Crafting your product vision and mission

Podcast

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Join us at #mtpcon London in 2025 – mark your calendars

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

5 ways to invent and simplify as an AI/ML product manager

Why teams often struggle with OKRs: A conversation with Jeff Gothelf

Building your own user experience and software stack: This week’s product news

Robert Schlaff is Executive Director at JPMorgan Chase, transforming the company from the world’s greatest bank to the world’s greatest tech company. In his 2 decades as a Product Manager, he’s been the head of Banking Business Development at Amazon Web Services, Commercial Digital Product at AIG, and online treasury management at Citi. He started his career as a software engineer working on innovation projects that were far ahead of their time like speech enabled phone systems (via landline phones), mobile notifications (via Blackberry) and Artificial Intelligence (via Expert Systems). He blogs at schlaff.com.

Robert Schlaff

Congratulations! You&#8217;re about to get a new intern! She may be named Microsoft Copilot, OpenAI, ChatGPT, or Google Bard. Whatever her name, she&#8217;s a large language model that can make you more efficient and creative.
Rather than thinking of this new assistant as just another tool, I&#8217;ve found it useful to think of her as a virtual intern. She’s a Large Language Model (LLM) built from neural networks that simulate the human brain. This makes her very different from other virtual assistants like Siri or Alexa. Rather than just providing you with the answers to questions, she can collaborate with you and help you develop your ideas.
But she&#8217;s different from your typical intern. She&#8217;s been trained on the entire internet. She&#8217;s read everything from Shakespeare to Seinfeld to quantum mechanics, and she&#8217;s lightning fast at pulling all this stuff together. And while she&#8217;s surprisingly creative, she has a habit of making stuff up. Overall, she&#8217;s very diligent but a bit quirky which makes her difficult to manage. To help you manage her more effectively, I&#8217;ve put together these five tips: 
<h2>Set clear objectives</h2>
She&#8217;s a great researcher and she’s very educated, but she needs to be pointed in the right direction. You should do this for any employee, but your virtual intern takes it to another level. Tell her to do something, and she will execute the hell out of it without a fuss—whether or not it makes sense. She has no clue what to prioritize. If you tell her to &#8220;Explain quantum mechanics as if you were a dog,&#8221; she will come back with “Quantum mechanics is when you can be in two places at once, like when you chase your own tail and catch it.&#8221; It&#8217;s important to remember that, despite her name, she&#8217;s not actually &#8220;intelligent&#8221; like a person. People often get confused by the words “Artificial Intelligence,” and think that a computer program can &#8220;just figure it out for them&#8221; for them without any guidance. She’s more like a GPS that can help you get where you’re going more effectively.
<h2>Take responsibility for her work</h2>
I don&#8217;t mean that you should plagiarize her work. But once she gives you an answer, you need to make sure it&#8217;s the right solution to your problem. This can be tricky because she writes in a very compelling fashion with lots of confidence, even when she&#8217;s wrong. Remember, she&#8217;s trained on the entire internet. But before you share her ideas with others, make sure you think them through and check that they apply to your situation. Today, many institutions rely on AI to make decisions for them. They rely on AI systems today to make lending decisions, hiring decisions, and parole decisions. Just like with a human intern, you own that decision and can&#8217;t pass off responsibility to someone else. &#8220;Don&#8217;t blame me, the AI said so&#8221; is not an acceptable answer.
<h2>Check her work carefully</h2>
She works really hard and bullshits really well. She does both of these things literally a billion times better than a human. Instead of saying &#8220;I don&#8217;t know,&#8221; she may create long expositions that are made up of whole cloth. These may even include references to fictitious websites, articles, or even legal cases that are completely made up. Recently, one of her fellow virtual interns worked for <a href="https://www.nytimes.com/2023/05/27/nyregion/avianca-airline-lawsuit-chatgpt.html">Roberto Mata when he sued the airline Avianca</a>. His ChatGPT intern cited a half dozen imaginary cases. Some people call it AI hallucinations, but the interns prefer to call it creative writing.
<h2>Learn to communicate better with her</h2>
Like any new super smart intern, she thinks she knows everything and doesn&#8217;t know when to ask for help. Therefore it&#8217;s useful to guide her with prompts and examples of how to do things. As an example, virtual interns are notoriously bad at math. This is because she likes to jump to conclusions based on what she&#8217;s seen before. When I asked her, &#8220;What&#8217;s (7 * 4) – (16 * 2)?&#8221; she told me the answer was -12, which is wrong. The right answer is -4. But it is the right answer to &#8220;What&#8217;s (5 * 4) – (16 * 2)?&#8221; but in math, close isn&#8217;t good enough. Remember, she doesn&#8217;t think the same way a person does. But when I change the prompt slightly to &#8220;What&#8217;s (7 * 4) – (16 * 2)? Go step by step,&#8221; she provides a flawless answer and shows all the intermediate steps. There&#8217;s a whole new field called <a href="https://en.wikipedia.org/wiki/Prompt_engineering">prompt engineering</a> to help communicate with her. 
<h2>Brainstorm lots of ideas</h2>
Use her as a brainstorming partner, not a ghostwriter. She’s great at generating ideas, so use her to explore different angles, perspectives, and examples. But remember, while she comes up with a lot of good ideas, she also comes up with a lot of bad ones. When asking for her to write something, don&#8217;t be proscriptive and rely on just one answer. Ask her for a few different options. Ask her questions like, &#8220;Give me 10 ideas of how AI can be used to help me at work.&#8221; You&#8217;ll get some good ones, like &#8220;Automate repetitive and tedious tasks such as data entry, scheduling, invoicing, etc.&#8221; but also some bad ones like, &#8220;You can use AI to impersonate your coworkers and spy on them.&#8221; I&#8217;m just kidding. For that one I asked her for 10 &#8220;bad&#8221; ways to use AI and picked the worst one. 
<h2>Just try it</h2>
Congratulations! Now you&#8217;re ready to work with your new intern. Don’t be scared. The best way to master this new world is to experiment. She&#8217;s not a real person so she won’t mind if you send her on crazy missions or try out new things. It’s a great way to test your ideas. You can play with ChatGPT or Bing&#8217;s AI Chat for free, which is also a really fun way to see what she can do. For example, I&#8217;ve found that she can have the cast of Seinfeld explain difficult concepts. Here’s how she <a href="https://sl.bing.net/5ixOYOcXgy">explains LLMs through a Seinfeld script</a>.
Remember to think of her as a partner rather than someone to fetch your coffee. She can help come up with new and innovative solutions that you’ve never thought of. Leverage her correctly and she will surprise you, inspire you, and challenge you.
<h2>Explore, create, and have fun!</h2>
If you&#8217;d like to know how you can partner with large language models to get things done, check out <a href="http://impromptubook.com/">Impromptu</a> (especially the first 50 pages) by Reid Hoffman, one of the founders of OpenAI, who co-authored the book with ChatGPT. If you want something more basic, check out John Maeda&#8217;s book <a href="https://www.amazon.com/How-Speak-Machine-Computational-Thinking/dp/039956442X">How to Speak Machine</a>. If you want something more hardcore, read through Stephen Wolfram&#8217;s essays <a href="https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/">What is ChatGPT and How does it Work</a> and <a href="https://writings.stephenwolfram.com/2023/03/will-ais-take-all-our-jobs-and-end-human-history-or-not-well-its-complicated/">Will AIs Take All Our Jobs and End Human History—or Not? Well, It’s Complicated&#8230;</a> To learn more about prompt engineering, watch  The Past and Future of Prompt Engineering by Riley Goodside, the world&#8217;s most famous prompt engineer.

core/freeform

LLM workflows for product managers: 3 key takeaways (Niloufar Salehi, Assistant Professor at UC Berkeley) – ProductTank SF

The future of product management: Insights from ProductTank San Francisco

Product lessons learned making early moves with AI in media: Lindsey Jayne (CPO, Financial Times)

A year with ChatGPT and product innovation: Navigating the AI landscape

How to keep your head about generative AI (when everyone is losing theirs) by Claire Woodcock

Meet your new intern! Five tips to manage ChatGPT

Robert Schlaff

Read more

Comments