back

What We Learned from Using LLMs in Pinterest — Mukuntha Narayanan, Han Wang, Pinterest

Pinterest finds machine learning's sweet spot

Pinterest's journey with large language models offers a fascinating glimpse into how even tech-forward companies must navigate the complex reality of AI implementation. At a recent conference, Pinterest engineers Mukuntha Narayanan and Han Wang shared candid insights about their experiences integrating LLMs into Pinterest's recommendation systems. Their presentation revealed that despite the hype surrounding generative AI, the path to meaningful implementation requires pragmatism, experimentation, and a willingness to challenge assumptions.

Key Points

  • Pinterest found that smaller, specialized models often outperformed larger general-purpose models for their specific use cases, challenging the "bigger is better" narrative dominating AI discussions.

  • The company's gradual approach to LLM adoption—starting with non-critical features before expanding to core systems—demonstrates the importance of building organizational confidence through smaller wins.

  • Despite technical challenges, Pinterest discovered that the most significant hurdles were organizational: securing executive buy-in, managing costs, and developing new expertise across teams.

  • The ROI calculation for LLMs required Pinterest to consider not just raw performance metrics but also maintenance costs, inference speed, and alignment with business objectives.

The Insight That Changes Everything

The most profound revelation from Pinterest's experience is that successful AI implementation isn't about chasing the latest, largest models—it's about finding the right tool for the specific job. This insight directly contradicts the prevailing Silicon Valley narrative that companies must adopt cutting-edge models like GPT-4 to remain competitive. Pinterest's team discovered that in many cases, smaller specialized models (even non-LLM alternatives) delivered superior results at lower costs when tailored to their particular use cases.

This matters tremendously in today's context, where companies are under immense pressure to demonstrate AI initiatives while simultaneously facing budget constraints. Pinterest's experience suggests that thoughtful, targeted AI deployment may yield better business outcomes than rushing to implement headline-grabbing but potentially unsuitable technologies. As AI adoption accelerates across industries, this measured approach could prevent billions in misallocated resources.

Beyond the Presentation: Practical Implications

What Pinterest's team didn't explicitly address is how their approach might translate to companies with fewer technical resources. For mid-sized businesses without deep machine learning expertise, the lesson isn't to build custom models from scratch, but rather to focus on well

Recent Videos

May 6, 2026

Hermes Agent Master Class

https://www.youtube.com/watch?v=R3YOGfTBcQg Welcome to the Hermes Agent Master Class — an 11-episode series taking you from zero to fully leveraging every feature of Nous Research's open-source agent. In this first episode, we install Hermes from scratch on a brand new machine with no prior skills or memory, walk through full configuration with OpenRouter, tour the most important CLI and slash commands, and run our first real task: a competitor research report on a custom children's book AI business idea. Every future episode will build on this fresh install so you can see the compounding value of the agent in real time....

Apr 29, 2026

Andrej Karpathy – Outsource your thinking, but you can’t outsource your understanding

https://www.youtube.com/watch?v=96jN2OCOfLs Here's what Andrej Karpathy just figured out that everyone else is still dancing around: we're not in an era of "better models." We're in a different era of computing altogether. And the difference between understanding that and not understanding it is the difference between being a vibe coder and being an agentic engineer. Last October, Karpathy had a realization. AI didn't stop being ChatGPT-adjacent. It fundamentally shifted. Agentic coherent workflows started to actually work. And he's spent the last three months living in side projects, VB coding, exploring what's actually possible. What he found is a framework that explains...

Mar 30, 2026

Andrej Karpathy on the Decade of Agents, the Limits of RL, and Why Education Is His Next Mission

A summary of key takeaways from Andrej Karpathy's conversation with Dwarkesh Patel In a wide-ranging conversation with Dwarkesh Patel, Andrej Karpathy — former head of AI at Tesla, founding member of OpenAI, and creator of some of the most popular AI educational content on the internet — shared his views on where AI is headed, what's still broken, and why he's now pouring his energy into education. Here are the key takeaways. "It's the Decade of Agents, Not the Year of Agents" Karpathy's now-famous quote is a direct pushback on industry hype. Early agents like Claude Code and Codex are...