Released
20 May 2026
Status
Legacy
Context
1M
Max output
131.1K
Input per 1M tokens
$2.50
Output per 1M tokens
$7.50
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
—
Reasoning
Yes
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning35.1424 of 4
Factuality & hallucination55.8161 of 1
Human preference63.3Not ranked2 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved19.0%Independent—7 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)92.3%Third party——https://conceptualreasoning.ai/dtbench via Epoch AI
Earthborne Rangers (EBR-bench)Objectives reached9.5%Independent—25 Jun 2026Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4402Third party——https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved32.0%Independent—28 Jul 2026Epoch AI
Mystery Game PuzzlesPuzzles solved26.0%Independentnone27 Aug 2026Epoch AI
SimpleBenchScore (AVG@5)70.4%Third party——SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy90.9%Independent—7 Aug 2026Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy34.1%Independent—13 Jun 2026Epoch AI
FrontierMath Tiers 1-3Accuracy64.6%Independent—13 Jun 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy95.6%Independent—7 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SWE-bench Verified% resolved77.3%Independent—18 Jun 2026Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)55.8%Independent—27 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1515Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes8931Independent—25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1475Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes3924Independent—25 Sep 2026Arena

Other Qwen-Max versions

Sources