Released
22 Dec 2025
Status
Legacy
Context
204.8K
Max output
131.1K
Input per 1M tokens
$0.60
Output per 1M tokens
$2.20
Open weights
Yes
License
mit
Parameters
—
Knowledge cutoff
—
Reasoning
Yes
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning19.2802 of 4
Factuality & hallucination32.2501 of 1
Human preference55.4Not ranked2 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved6.0%Independent—29 Jan 2026Epoch AI
Humanity's Last Exam (HLE)Accuracy42.8%Self-reported——Model Card via Hugging Face Community Evals
SimpleBenchScore (AVG@5)47.7%Third party——SimpleBench Leaderboard via Epoch AI
SimpleBenchScore (AVG@5)47.7%Third party——SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy83.3%Independent—29 Jan 2026Epoch AI
GPQA DiamondAccuracy85.7%Self-reported——Model Card via Hugging Face Community Evals

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4 (v1)Accuracy0.0%Independent—30 Jan 2026Epoch AI
FrontierMath Tiers 1-3 (v1)Accuracy2.4%Independent—30 Jan 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy83.3%Independent—29 Jan 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Terminal-Bench 2.0Accuracy (mean over trials)33.4%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)33.3%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI

Long context

Long context results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
CL-benchTasks solved15.9%Source not stated——Epoch AI via Epoch AI
CL-bench LifeTasks solved10.9%Source not stated——Epoch AI via Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)32.2%Independent—27 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1435Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes4007Independent—25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1441Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes12217Independent—25 Sep 2026Arena

Other GLM versions

Sources