back

I Tested This Week’s AI Tools (And Broke Them)

AI fails at being human — for now

Artificial intelligence is becoming eerily good at mimicking human expression, but as YouTuber Tom Scott recently demonstrated, even the most advanced AI tools still reveal their mechanical nature when pushed to their limits. In his latest video "I Tested This Week's AI Tools (And Broke Them)," Scott puts several cutting-edge AI applications through a series of increasingly challenging tests, exposing both their impressive capabilities and glaring limitations. The results highlight a crucial reality about today's AI landscape: these systems aren't truly intelligent—they're sophisticated pattern-matching machines with predictable breaking points.

Key Points

  • AI voice cloning technology can now replicate human speech with remarkable accuracy, including emotional inflections and natural-sounding pauses, but still falters when handling complex linguistic scenarios.

  • Video generation tools have progressed significantly but continue to struggle with maintaining visual consistency, managing temporal relationships, and handling specific details—especially human hands and complex movements.

  • Current AI systems fundamentally operate by pattern matching against their training data rather than possessing genuine understanding, leading to predictable failure modes when faced with novel requests or logical contradictions.

  • The field is advancing rapidly through both incremental improvements and occasional breakthrough moments, suggesting today's limitations could be tomorrow's solved problems.

  • The most successful implementations of AI technology focus on augmenting human capabilities rather than completely replacing them.

The Illusion of AI Understanding

The most revealing insight from Scott's experiments isn't the specific failures of individual AI systems, but rather what these failures collectively tell us about artificial intelligence as a whole. Each breakdown point—whether it's Claude's inability to maintain consistent reasoning, video generators creating anatomical nightmares, or voice synthesis stumbling over unusual speaking patterns—stems from the same fundamental limitation: these systems don't understand the world in any meaningful sense.

This matters tremendously in a business context because it shapes how we should approach AI implementation. Companies rushing to replace human workers with AI solutions are often making a category error—confusing impressive pattern recognition with genuine comprehension. The AI tools Scott tested perform remarkably well within their narrow domains, but they lack the generalized intelligence to handle edge cases, make contextual judgments, or recognize when they're producing nonsense.

The Uncanny Valley of Business AI

What Scott's video doesn't explore is how these AI

Recent Videos

May 6, 2026

Hermes Agent Master Class

https://www.youtube.com/watch?v=R3YOGfTBcQg Welcome to the Hermes Agent Master Class — an 11-episode series taking you from zero to fully leveraging every feature of Nous Research's open-source agent. In this first episode, we install Hermes from scratch on a brand new machine with no prior skills or memory, walk through full configuration with OpenRouter, tour the most important CLI and slash commands, and run our first real task: a competitor research report on a custom children's book AI business idea. Every future episode will build on this fresh install so you can see the compounding value of the agent in real time....

Apr 29, 2026

Andrej Karpathy – Outsource your thinking, but you can’t outsource your understanding

https://www.youtube.com/watch?v=96jN2OCOfLs Here's what Andrej Karpathy just figured out that everyone else is still dancing around: we're not in an era of "better models." We're in a different era of computing altogether. And the difference between understanding that and not understanding it is the difference between being a vibe coder and being an agentic engineer. Last October, Karpathy had a realization. AI didn't stop being ChatGPT-adjacent. It fundamentally shifted. Agentic coherent workflows started to actually work. And he's spent the last three months living in side projects, VB coding, exploring what's actually possible. What he found is a framework that explains...

Mar 30, 2026

Andrej Karpathy on the Decade of Agents, the Limits of RL, and Why Education Is His Next Mission

A summary of key takeaways from Andrej Karpathy's conversation with Dwarkesh Patel In a wide-ranging conversation with Dwarkesh Patel, Andrej Karpathy — former head of AI at Tesla, founding member of OpenAI, and creator of some of the most popular AI educational content on the internet — shared his views on where AI is headed, what's still broken, and why he's now pouring his energy into education. Here are the key takeaways. "It's the Decade of Agents, Not the Year of Agents" Karpathy's now-famous quote is a direct pushback on industry hype. Early agents like Claude Code and Codex are...