Released
7 Apr 2026
Status
Legacy
Context
204.8K
Max output
131.1K
Input per 1M tokens
$1.40
Output per 1M tokens
$4.40
Open weights
Yes
License
mit
Parameters
—
Knowledge cutoff
—
Reasoning
Yes
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning30.4582 of 4
Factuality & hallucination34.0461 of 1
Human preference62.2Not ranked2 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved19.0%Independent—10 Aug 2026Epoch AI
Humanity's Last Exam (HLE)Accuracy52.3%Self-reported——Model Card via Hugging Face Community Evals
SimpleBenchScore (AVG@5)55.1%Third party——SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy89.9%Independent—10 Aug 2026Epoch AI
GPQA DiamondAccuracy86.2%Self-reported——Model Card via Hugging Face Community Evals

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4 (v1)Accuracy12.5%Independent—12 May 2026Epoch AI
FrontierMath Tiers 1-3Accuracy36.8%Independent—29 Aug 2026Epoch AI
FrontierMath Tiers 1-3Accuracy24.9%Independentnone28 Aug 2026Epoch AI
FrontierMath Tiers 1-3 (v1)Accuracy33.4%Independent—11 May 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy93.3%Independent—10 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
ExploitBenchMean capability18.1%Source not stated——Epoch AI via Epoch AI
ExploitBenchMean capability16.0%Source not stated——Epoch AI via Epoch AI
SWE-bench Verified% resolved74.2%Independent—15 May 2026Epoch AI
WeirdML (v2)Average accuracy57.1%Third party——https://htihle.github.io/weirdml.html via Epoch AI

Professional knowledge work

Professional knowledge work results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
APEX-AgentsPass@1 (all rubric criteria met)40.9%Source not stated——Epoch AI via Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)34.0%Independent—27 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1508Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes10822Independent—25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1465Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes56463Independent—25 Sep 2026Arena

Other GLM versions

Sources