Released
9 Jun 2026
Status
Legacy
Context
1M
Max output
128K
Input per 1M tokens
$10.00
Output per 1M tokens
$50.00
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
Jan 2026
Reasoning
Yes
Modalities
text, image → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning56.9114 of 4
Coding & software engineering62.413 of 5
Vision & multimodal understanding8.3Not ranked1 of 3
Factuality & hallucination70.751 of 1
Human preference54.3175 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved41.0%Independentmax9 Jun 2026Epoch AI
Chess PuzzlesPuzzles solved41.0%Independenthigh6 Aug 2026Epoch AI
Chess PuzzlesPuzzles solved28.0%Independentlow6 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)98.4%Third partymax—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)97.3%Third partyxhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)96.5%Third partyhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)95.7%Third partymedium—https://conceptualreasoning.ai/dtbench via Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)91.5%Third partylow—https://conceptualreasoning.ai/dtbench via Epoch AI
Earthborne Rangers (EBR-bench)Objectives reached39.5%Independentmax17 Jul 2026Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.6115Third partyhigh—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.6102Third partyxhigh—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.6034Third partymax—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.6032Third partymedium—https://conceptualreasoning.ai/lmca via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.5959Third partylow—https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved52.0%Independentmax31 Jul 2026Epoch AI
SimpleBenchScore (AVG@5)81.9%Third partymax—SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy85.9%Independentmax6 Aug 2026Epoch AI
GPQA DiamondAccuracy83.3%Independenthigh6 Aug 2026Epoch AI
GPQA DiamondAccuracy78.8%Independentlow6 Aug 2026Epoch AI
Surface Evolver BenchMean score (partial credit)95.0%Third partyhigh—https://yhenon.github.io/surface-evolver-llm-eval/ via Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy90.2%Independentmax9 Jun 2026Epoch AI
FrontierMath Tiers 1-3Accuracy87.0%Independentmax9 Jun 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy100.0%Independenthigh6 Aug 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy99.7%Independentmax10 Jun 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy97.8%Independentlow6 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DeepSWEPass@169.9%Third partyxhigh—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@169.7%Third partymax—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@168.6%Third partyhigh—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@165.4%Third partymedium—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@159.6%Third partylow—https://deepswe.datacurve.ai/ via Epoch AI
FrontierCodeMain score (Mean@5)53.5%Third partyunknown—https://cognition.com/frontiercode via Epoch AI
MirrorCodeScore63.9%Independenthigh10 Aug 2026Epoch AI
PostTrainBenchAverage score41.8%Source not statedmax—Epoch AI via Epoch AI
WeirdML (v2)Average accuracy91.9%Third partymax—https://htihle.github.io/weirdml.html via Epoch AI
WeirdML (v2)Average accuracy87.8%Third partyhigh—WeirdML Leaderboard via Epoch AI

Professional knowledge work

Professional knowledge work results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
APEX-AgentsPass@1 (all rubric criteria met)63.6%Source not stated——Epoch AI via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Furniture AssemblyScore35.8%Independentmax10 Sep 2026Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)70.7%Independentxhigh10 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1627Independenthigh25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes13086Independenthigh25 Sep 2026Arena
Document Arena (arena.ai)Arena score (Elo scale)1499Independent—13 Sep 2026Arena
Document Arena (arena.ai)Votes8497Independent—13 Sep 2026Arena
Search Arena (arena.ai)Arena score (Elo scale)1229Independent—24 Aug 2026Arena
Search Arena (arena.ai)Votes41795Independent—24 Aug 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1504Independenthigh25 Sep 2026Arena
Text Arena (arena.ai)Votes36462Independenthigh25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1310Independenthigh28 Sep 2026Arena
Vision Arena (arena.ai)Votes13483Independenthigh28 Sep 2026Arena

Other Claude Fable versions

Sources