Released
16 Apr 2026
Status
Legacy
Context
1M
Max output
65.5K
Input per 1M tokens
$0.25
Output per 1M tokens
$1.50
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
—
Reasoning
Yes
Modalities
text, image, video → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning24.8703 of 4
Factuality & hallucination15.9611 of 1

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved20.0%Independent—7 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)77.1%Third party——https://conceptualreasoning.ai/dtbench via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.3098Third party——https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved18.0%Independentnone27 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved12.0%Independent—27 Aug 2026Epoch AI
SimpleBenchScore (AVG@5)35.2%Third party——SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy83.3%Independent—7 Aug 2026Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4 (v1)Accuracy0.0%Independent—12 May 2026Epoch AI
FrontierMath Tiers 1-3Accuracy22.5%Independentnone29 Aug 2026Epoch AI
FrontierMath Tiers 1-3Accuracy17.2%Independent—29 Aug 2026Epoch AI
FrontierMath Tiers 1-3 (v1)Accuracy10.3%Independent—12 May 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy84.4%Independent—7 Aug 2026Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)15.9%Independent—27 Aug 2026Epoch AI

Other Qwen-Flash versions

Sources