Released
9 Jul 2026
Status
Current
Context
1.1M
Max output
128K
Input per 1M tokens
$0.20
Output per 1M tokens
$1.20
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
16 Feb 2026
Reasoning
Yes
Modalities
text, image → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning43.4303 of 4
Coding & software engineering53.5Not ranked2 of 5
Agentic tool use45.6Not ranked1 of 2
Vision & multimodal understanding17.9Not ranked1 of 3
Factuality & hallucination41.0361 of 1
Human preference49.1303 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved40.0%Independentmax9 Jul 2026Epoch AI
Chess PuzzlesPuzzles solved21.0%Independentlow7 Aug 2026Epoch AI
Chess PuzzlesPuzzles solved2.0%Independentnone7 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)89.1%Third partyxhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)88.8%Third partymax—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)86.7%Third partyhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)83.2%Third partymedium—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)80.0%Third partylow—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)69.3%Third partynone—https://conceptualreasoning.ai/dtbench via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4854Third partyxhigh—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4854Third partymax—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4738Third partyhigh—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4425Third partymedium—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4379Third partylow—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.414Third partynone—https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved21.0%Independentmax28 Jul 2026Epoch AI
Mystery Game PuzzlesPuzzles solved20.0%Independentnone30 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved17.0%Independentlow27 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved12.0%Independentmedium27 Aug 2026Epoch AI
SimpleBenchScore (AVG@5)46.8%Third partyunknown—SimpleBench Leaderboard via Epoch AI
SimpleBenchScore (AVG@5)46.8%Third partyxhigh—https://lmcouncil.ai/benchmarks via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy91.6%Independentmax9 Jul 2026Epoch AI
GPQA DiamondAccuracy82.3%Independentlow7 Aug 2026Epoch AI
GPQA DiamondAccuracy63.6%Independentnone7 Aug 2026Epoch AI
Surface Evolver BenchMean score (partial credit)61.9%Third partymedium—https://yhenon.github.io/surface-evolver-llm-eval/ via Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy61.0%Independentmax9 Jul 2026Epoch AI
FrontierMath Tiers 1-3Accuracy82.1%Independentmax9 Jul 2026Epoch AI
FrontierMath Tiers 1-3Accuracy41.4%Independentlow29 Aug 2026Epoch AI
FrontierMath Tiers 1-3Accuracy39.6%Independentnone29 Aug 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy98.3%Independentmax9 Jul 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy66.7%Independentlow7 Aug 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy40.0%Independentnone7 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DeepSWEPass@167.2%Third partymax—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@156.9%Third partyxhigh—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@144.2%Third partyhigh—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@111.3%Third partymedium—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@11.5%Third partylow—https://deepswe.datacurve.ai/ via Epoch AI
FrontierCodeMain score (Mean@5)39.8%Third partyunknown—https://cognition.com/frontiercode via Epoch AI
WeirdML (v2)Average accuracy60.9%Third partyhigh—https://htihle.github.io/weirdml.html via Epoch AI

Agentic tool use

Agentic tool use results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
BALROGAverage progress45.6%Third partymax—https://balrogai.com/ via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Furniture AssemblyScore42.5%Independentmax10 Sep 2026Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)41.0%Independentmax10 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Document Arena (arena.ai)Arena score (Elo scale)1462Independentxhigh13 Sep 2026Arena
Document Arena (arena.ai)Votes5766Independentxhigh13 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1454Independentxhigh25 Sep 2026Arena
Text Arena (arena.ai)Votes35823Independentxhigh25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1259Independentxhigh28 Sep 2026Arena
Vision Arena (arena.ai)Votes10099Independentxhigh28 Sep 2026Arena

Other GPT-5 versions

Sources