Anthropic’s first technical PM on token maxing, the jagged edge, and living in the future

Name: Anthropic’s first technical PM on token maxing, the jagged edge, and living in the future
Uploaded: 2026-07-26T12:30:06.000Z
Duration: 1 h 33 min 50 s
Channel: Lenny's Podcast

Lenny's PodcastJuly 26, 20261h 33m

Topics66

Early Days at Anthropic0:00 Opus 45 and Claude Code0:30 Product Role Changes1:00 Early Anthropic Culture2:00 Golden Gate Claude4:30 Bottoms-Up Culture7:30 Opus 3 Milestone9:00 Coding Focus11:00 Opus 45 and Claude Code Synergy12:30 Exponential Improvement14:30 Preparing for Acceleration15:00 Product and User Overhang17:30 Discovery Process19:30 Token Maxing20:00 Working in Public21:30 Exploration-Based Discovery23:00 Labs Team23:30 What Enables Labs to Work26:00 Researcher Personality and Zero-to-One Focus27:12 What Researchers Actually Do27:30 Medium and Long-Term Vision Combined with Immediate Improvements28:32 High-Impact User Areas for Research29:31 Making User Feedback Actionable30:02 Bridging User Feedback to Research Development31:32 What Makes Successful Researchers32:01 Ambitious Thinking and Forward Compatibility33:31 Frontier Model Scrutiny and Safeguards35:32 Internal Access Advantages and Model Inclusivity37:30 Product Manager Hiring Criteria39:30 Evals as the New PRDs40:30 Understanding User Pain Points Through Token Analysis42:01 Creating Evals from User Feedback44:00 Test-Driven Development for Product Managers46:31 When PRDs Remain Valuable47:31 Hands-On Requirements for Product Leadership49:32 Maintaining Theory of Mind Through Direct Experience52:02 Finding Joy in AI Work52:30 Finding Joy and Building Community with AI54:53 Going Deep vs. Surface Level Exploration56:00 Experimenting with Joy and Product Prioritization57:32 Using Claude for Management and Coaching58:32 Building Personalized Coaching Skills1:00:01 Maintaining Independent Thinking While Using AI1:01:32 Delegating Writing vs. Maintaining Personal Voice1:02:31 Alignment Research and the Value of Pushback1:03:32 Why Alignment Makes Claude Better1:05:01 Protecting Your Thinking1:06:30 AI Writing Quality and Future Possibilities1:07:32 Why AI Isn't Great at Writing Yet1:09:31 The Work in Progress Nature of AI Advancement1:11:00 Where Human Brains Will Continue to Be Most Valuable1:12:01 What to Encourage Kids to Learn1:14:31 When to Introduce Kids to AI1:16:01 Avoiding Burnout While Working at the Center of AI1:17:02 The Hive Mind and Team Support1:18:31 The Power of Other Humans1:20:31 Sustaining Fast-Paced Development1:21:26 Connecting Ideas and Personal Reflections1:22:00 The Enduring Value of Product Management1:23:01 The Core Challenge for Product Managers1:24:01 Lightning Round: Book Recommendations1:24:30 Lightning Round: Favorite Recent Media1:26:30 Lightning Round: Favorite Recent Product Discovery1:27:00 Lightning Round: Life Motto1:28:00 Lightning Round: Lessons from High-Yield Bond Trading1:29:30 How to Connect and Provide Value1:31:32

In a Nutshell

Diane Penn, Anthropic's first technical PM, explains that evals have replaced PRDs as the core product artifact because user value emerges from token-level experimentation rather than traditional roadmapping. The company operates in exponential improvement cycles where frontier models and products like Claude Code co-evolve—Opus 3's coding focus and Opus 4.5's agentic capabilities only became transformative through simultaneous product vehicles. Success requires bottoms-up experimentation, first-principles thinking, and maintaining human judgment while using AI to push back rather than merely agree, with teams that treat model releases as collaborative high-performance efforts rather than individual work.

AI-Generated Notes

These notes were generated by AI and may contain inaccuracies.

In 2023 when Diane Penn started at Anthropic, nobody said Anthropic and Claude and coding in the same sentence. People felt OpenAI was so far ahead that Anthropic had no chance. At the time, Penn saw people starting to use models not just for code autocomplete, but actually writing long form code, and saw an opportunity to train Opus 3 to be better at it. That was the inflection point.

What was magical about Opus 45 is that Anthropic now not just had a model but a vehicle - a great product experience like Claude Code. Opus 45 wouldn't have had that moment without a product like Claude Code, and Claude Code wouldn't have had that type of adoption accelerated without Opus 45.

The way to drive user value is to figure out the right user feedback. The team has a saying that evals are the new PRDs. If you are willing to spend $100,000 a year right now in tokens, you are living the way somebody in 2028 is going to live. You have to sweat the tokens as much as you sweat the pixels. You have to be using the models to come up with good and great and better ideas, and there's no substitute for that. People need to be more ambitious with AI tools because they're just capable of so much.

One thing asked of the team is: let's say Claude 8 comes around. What changes in what users do? What does that mean for how you're building today?

Diane Penn joined Anthropic as the first technical product manager over three years ago, when the product team was just five engineers. She helped ship every model from Claude 2 through Fable, and helped incubate and launch Claude Code, MCP, skills, Claude Design, and core capabilities like computer use, tool use, and reasoning.

When Penn joined in 2023, there were five product engineers and one engineer for the entirety of the API business. The culture was really strong and people walked the walk of the mission, culture, and values. The energy was very much like a startup. They were trying to find their identity in the early years - there was the technology, but also the question of how that technology brings value to users and society.

One of the moments where Anthropic started to get into their groove was shipping Golden Gate Claude. This was published for about 24 hours. They had just published early interpretability research in early 2024. One of the examples was features of the model within the layers that express certain types of thematics. One theme identified was bullet point writing, another was people and places, and one that came up frequently was the Golden Gate Bridge.

When that feature was dialed up, Claude would obsess about the Golden Gate Bridge. In every response, it would come back and talk about the Golden Gate Bridge. If asked for a recipe for making spaghetti, it would say the orange color is just like international red that the Golden Gate Bridge looked like. The entire experience was spun up on the Claude.ai website within 24 hours, involving engineering, product, design, and research teams working together.

It reached only about 2,000 people but made them feel they could bring new user experiences and showcase research in a way that was different and authentic to them, at a very startup-like pace. It was one of the hidden inflection points where they were starting to find their identity that they could build products and experiences different from competitors.

Sign in to read the full notes

Get access to AI-generated notes, topic timestamps, and more.

Anthropic’s first technical PM on token maxing, the jagged edge, and living in the future

Early Days at Anthropic00:00

Opus 45 and Claude Code00:30

Product Role Changes01:00

Early Anthropic Culture02:00

Sign in to read the full notes