Grok 3 Unveiled: xAI’s leap in AI innovation
Grok 3 Shatters AI Benchmarks: xAI's Latest Model Sets New Industry Standards with Unprecedented 1400+ Arena Score
xAI, led by Elon Musk, has launched Grok 3, claiming it to be the world’s most advanced AI model. Following its live demo, the model has set new AI performance benchmarks—most notably becoming the first to exceed a score of 1400 on Chatbot Arena. Grok 3 outperforms established competitors like OpenAI’s GPT-4o and Google’s Gemini 2 Pro in reasoning, coding, and problem-solving capabilities. The tech community has praised this achievement, particularly noting xAI’s swift progress as a newcomer in the AI field. Within xAI, the model’s development has generated significant excitement, with both team members and industry observers anticipating its future applications and potential to advance AI technology further.
Key Insights from the Grok 3 Video
According to Elon, Grok 3 is an order of magnitude more capable than Grok 2.
The capacity was doubled in 92 days!
Total GPUs: 200K
All of this compute was used to improve Grok — which has lead to Grok 3.
Grok 3’s training was ten times more extensive than Grok 2’s. While its initial pretraining phase concluded in early January, the model continues to undergo training.
Here are the benchmark numbers:
Grok 3 significantly outperforms other models in its category such as Gemini 2 Pro and GPT-4o. Even Grok-3 mini shows to be competitive.
Results of early Grok 3 in the Chatbot Arena (LMSYS)
It reached an Elo score of 1400 which no other model has achieved.
The model score keeps improving.
Grok 3 also has reasoning capabilities too!
The Grok team has been testing these capabilities which they have unlocked using RL.
The model is good, especially in coding.
Grok 3 Reasoning performance:
The results correspond to the beta version of Grok-3 Reasoning.
It outperforms o1 and DeepSeek-R1 when given more test-time compute (allowing it to think longer).
The Grok 3 mini reasoning model is also very capable.
More on DeepSearch:
- the model can think deeply about user intent
- what facts to consider
- how many websites to browse
- it can cross-validate different sources
DeepSearch also exposes the steps that it takes to conduct the search itself.
What others are saying on X:
An early version of Grok-3 (codename “chocolate”) has claimed the #1 spot in Arena!
Grok-3 has achieved two major milestones:
- First model ever to break the 1400 score barrier
- #1 ranking across all categories—an increasingly challenging feat
I was given early access to Grok 3 earlier today, making me I think one of the first few who could run a quick vibe check.
— Andrej Karpathy (@karpathy) February 18, 2025
Thinking
✅ First, Grok 3 clearly has an around state of the art thinking model ("Think" button) and did great out of the box on my Settler's of Catan… pic.twitter.com/qIrUAN1IfD
BREAKING: @xAI early version of Grok-3 (codename “chocolate”) is now #1 in Arena! 🏆
— lmarena.ai (formerly lmsys.org) (@lmarena_ai) February 18, 2025
Grok-3 is:
– First-ever model to break 1400 score!
– #1 across all categories, a milestone that keeps getting harder to achieve
Huge congratulations to @xAI on this milestone! View thread 🧵… https://t.co/p8z8lccNd5 pic.twitter.com/hShGy8ZN1o
Recent Blog Posts
AI and Jobs: What Three Decades of Building Tech Taught Me About What’s Coming
In 2023, I started warning people. Friends. Family. Anyone who would listen. I told them AI would upend their careers within three years. Most nodded politely and moved on. Some laughed. A few got defensive. Almost nobody took it seriously. It's 2026 now. I was right. I wish I hadn't been. Who Am I to Say This? I've spent thirty years building what's next before most people knew it was coming. My earliest partner was Craig Newmark. We co-founded DigitalThreads in San Francisco in the mid-90s — Craig credits me with naming Craigslist and the initial setup. That project reshaped...
Feb 12, 2026The Species That Wasn’t Ready
Last Tuesday, Matt Shumer — an AI startup founder and investor — published a viral 4,000-word post on X comparing the current moment to February 2020. Back then, a few people were talking about a virus originating out of Wuhan, China. Most of us weren't listening. Three weeks later, the world rearranged itself. His argument: we're in the "this seems overblown" phase of something much bigger than Covid. The same morning, my wife told me she was sick of AI commercials. Too much hype. Reminded her of Crypto. Nothing good would come of it. Twenty dollars a month? For what?...
Feb 9, 2026Six ideas from the Musk-Dwarkesh podcast I can’t stop thinking about
I spent three days with this podcast. Listened on a walk, in the car, at my desk with a notepad. Three hours is a lot to ask of anyone, especially when half of it is Musk riffing on turbine blade casting and lunar mass drivers. But there are five or six ideas buried in here that I keep turning over. The conversation features Dwarkesh Patel and Stripe co-founder John Collison pressing Musk on orbital data centers, humanoid robots, China, AI alignment, and DOGE. It came days after SpaceX and xAI officially merged, a $1.25 trillion combination that sounds insane until you hear...