Released
2 Aug 2026
Status
Current
Context
1M
Max output
131.1K
Input per 1M tokens
$2.00
Output per 1M tokens
$6.00
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
—
Reasoning
Yes
Modalities
text, image, video → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning45.6272 of 4
Coding & software engineering57.5Not ranked1 of 5
Factuality & hallucination47.3281 of 1
Human preference72.0Not ranked2 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved40.0%Independentxhigh2 Sep 2026Epoch AI
Chess PuzzlesPuzzles solved29.0%Independentxhigh4 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)92.0%Third partyxhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.4624Third partyxhigh—https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved38.0%Independentxhigh5 Aug 2026Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy92.7%Independentxhigh4 Aug 2026Epoch AI
GPQA DiamondAccuracy92.3%Independentxhigh2 Sep 2026Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy46.3%Independentxhigh4 Aug 2026Epoch AI
FrontierMath Tier 4Accuracy34.1%Independentxhigh2 Sep 2026Epoch AI
FrontierMath Tiers 1-3Accuracy74.7%Independentxhigh4 Aug 2026Epoch AI
FrontierMath Tiers 1-3Accuracy65.6%Independentxhigh2 Sep 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy100.0%Independentxhigh2 Sep 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy99.4%Independentxhigh4 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DeepSWEPass@157.5%Third partyxhigh—https://deepswe.datacurve.ai/ via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Furniture AssemblyScore20.0%Independentxhigh10 Sep 2026Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)47.3%Independentxhigh2 Sep 2026Epoch AI
SimpleQA VerifiedAccuracy (% correct)45.8%Independentxhigh27 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1672Independentmax25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1662Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes6203Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes3469Independentmax25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1479Independentmax25 Sep 2026Arena
Text Arena (arena.ai)Votes21561Independentmax25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1301Independentmax28 Sep 2026Arena
Vision Arena (arena.ai)Votes10086Independentmax28 Sep 2026Arena

Other Qwen-Max versions

Sources