Released
17 Apr 2026
Status
Legacy
Context
1M
Max output
—
Input per 1M tokens
$1.25
Output per 1M tokens
$2.50
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
Dec 2025
Reasoning
Yes
Modalities
text, image → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning33.1492 of 4
Factuality & hallucination33.2491 of 1
Human preference41.0433 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved25.0%Independenthigh17 Jun 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)90.7%Third partyhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.3833Third partyhigh—https://conceptualreasoning.ai/lmca via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy88.8%Independenthigh17 Jun 2026Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy14.6%Independenthigh17 Jun 2026Epoch AI
FrontierMath Tiers 1-3Accuracy42.8%Independenthigh17 Jun 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy93.3%Independenthigh17 Jun 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
WeirdML (v2)Average accuracy49.9%Third partyunknown—https://htihle.github.io/weirdml.html via Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)33.2%Independenthigh27 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1357Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes15063Independent—25 Sep 2026Arena
Search Arena (arena.ai)Arena score (Elo scale)1193Independent—24 Aug 2026Arena
Search Arena (arena.ai)Votes91483Independent—24 Aug 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1442Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes71054Independent—25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1244Independent—28 Sep 2026Arena
Vision Arena (arena.ai)Votes25944Independent—28 Sep 2026Arena

Other Grok versions

Sources