Stateful environments for vertical agents — Josh Purtell, Synth Labs
AI agents' continuous learning revolution begins
Josh Purtell of Synth Labs offers a visionary perspective on how stateful environments could transform AI agent capabilities, enabling them to develop persistent memory and continuous learning rather than starting from scratch with each interaction. This approach represents a critical evolution in AI development, potentially bridging the gap between current limited-context systems and the more autonomous, adaptable tools businesses increasingly demand.
The concept of "stateful environments" might sound technically intimidating, but it addresses a fundamental limitation in today's AI landscape. Current systems essentially operate with amnesia—they process information within a limited window and forget everything once that interaction ends. Purtell proposes a framework where AI agents could maintain persistent memory across sessions, learning continuously through interaction with their environments and human users. This shift would make AI tools more practical for complex, ongoing business applications.
Key aspects of Purtell's vision:
-
AI agents should develop persistent memory across sessions rather than resetting with each interaction, allowing them to build expertise over time like human professionals.
-
Current limited-context systems (like traditional chatbots) create artificial constraints that prevent AI from handling complex, multi-step processes effectively.
-
The future of AI involves "vertical agents" specialized in specific domains that can maintain state, learn continuously, and develop increasingly valuable expertise through sustained use.
-
The development environment for AI needs fundamental rethinking—Purtell envisions containerized agents that can safely interact with protected data and systems while maintaining security boundaries.
-
Truly effective AI will blend supervised learning with self-directed discovery, creating systems that can explore solutions independently rather than merely following explicit instructions.
The paradigm shift we've been waiting for
The most compelling insight from Purtell's presentation is the recognition that today's AI systems are fundamentally handicapped by their inability to maintain state across interactions. Think about how bizarre it would be if your accountant or lawyer forgot everything about you between meetings, forcing you to re-explain your entire situation each time. Yet this is precisely how most AI tools currently function.
This matters tremendously in the business context because organizational knowledge and institutional memory represent some of the most valuable assets in any company. An AI system that can truly accumulate expertise—remembering past interactions, learning from mistakes, and building on previous insights—would transform from a sophisticated calculator into something more akin to
Recent Videos
Hermes Agent Master Class
https://www.youtube.com/watch?v=R3YOGfTBcQg Welcome to the Hermes Agent Master Class — an 11-episode series taking you from zero to fully leveraging every feature of Nous Research's open-source agent. In this first episode, we install Hermes from scratch on a brand new machine with no prior skills or memory, walk through full configuration with OpenRouter, tour the most important CLI and slash commands, and run our first real task: a competitor research report on a custom children's book AI business idea. Every future episode will build on this fresh install so you can see the compounding value of the agent in real time....
Apr 29, 2026Andrej Karpathy – Outsource your thinking, but you can’t outsource your understanding
https://www.youtube.com/watch?v=96jN2OCOfLs Here's what Andrej Karpathy just figured out that everyone else is still dancing around: we're not in an era of "better models." We're in a different era of computing altogether. And the difference between understanding that and not understanding it is the difference between being a vibe coder and being an agentic engineer. Last October, Karpathy had a realization. AI didn't stop being ChatGPT-adjacent. It fundamentally shifted. Agentic coherent workflows started to actually work. And he's spent the last three months living in side projects, VB coding, exploring what's actually possible. What he found is a framework that explains...
Mar 30, 2026Andrej Karpathy on the Decade of Agents, the Limits of RL, and Why Education Is His Next Mission
A summary of key takeaways from Andrej Karpathy's conversation with Dwarkesh Patel In a wide-ranging conversation with Dwarkesh Patel, Andrej Karpathy — former head of AI at Tesla, founding member of OpenAI, and creator of some of the most popular AI educational content on the internet — shared his views on where AI is headed, what's still broken, and why he's now pouring his energy into education. Here are the key takeaways. "It's the Decade of Agents, Not the Year of Agents" Karpathy's now-famous quote is a direct pushback on industry hype. Early agents like Claude Code and Codex are...