Released
7 Aug 2025
Status
Deprecated
Retired
11 Dec 2026
Context
400K
Max output
128K
Input per 1M tokens
$1.25
Output per 1M tokens
$10.00
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
30 Sep 2024
Reasoning
Yes
Modalities
text, image → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning35.4414 of 4
Coding & software engineering47.4Not ranked2 of 5
Agentic tool use41.272 of 2
Vision & multimodal understanding65.032 of 3
Factuality & hallucination50.1221 of 1
Human preference44.2393 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved37.0%Independenthigh8 Dec 2025Epoch AI
Chess PuzzlesPuzzles solved29.0%Independentmedium15 Jul 2026Epoch AI
Chess PuzzlesPuzzles solved24.0%Independentlow15 Jul 2026Epoch AI
Chess PuzzlesPuzzles solved16.0%Independentminimal15 Jul 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)90.7%Third partyhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
Earthborne Rangers (EBR-bench)Objectives reached12.7%Independenthigh29 Jun 2026Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.3999Third partyhigh—https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved23.0%Independenthigh5 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved16.0%Independentlow27 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved15.0%Independentmedium27 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved14.0%Independentminimal27 Aug 2026Epoch AI
SimpleBenchScore (AVG@5)56.7%Third partyhigh—https://lmcouncil.ai/benchmarks via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy86.2%Independenthigh29 Oct 2025Epoch AI
GPQA DiamondAccuracy85.4%Independentmedium7 Aug 2025Epoch AI
GPQA DiamondAccuracy71.7%Independentminimal20 Jul 2026Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy22.0%Independenthigh11 Jun 2026Epoch AI
FrontierMath Tier 4 (v1)Accuracy12.5%Independenthigh30 Oct 2025Epoch AI
FrontierMath Tier 4 (v1)Accuracy6.3%Independentmedium7 Aug 2025Epoch AI
FrontierMath Tiers 1-3Accuracy55.4%Independenthigh10 Jun 2026Epoch AI
FrontierMath Tiers 1-3Accuracy37.2%Independentlow27 Aug 2026Epoch AI
FrontierMath Tiers 1-3Accuracy18.2%Independentminimal27 Aug 2026Epoch AI
FrontierMath Tiers 1-3 (v1)Accuracy32.4%Independenthigh13 Nov 2025Epoch AI
FrontierMath Tiers 1-3 (v1)Accuracy27.2%Independentmedium13 Nov 2025Epoch AI
MATH Level 5Accuracy98.1%Independenthigh29 Oct 2025Epoch AI
MATH Level 5Accuracy97.9%Independentmedium20 Aug 2025Epoch AI
OTIS Mock AIME 2024-2025Accuracy91.4%Independenthigh29 Oct 2025Epoch AI
OTIS Mock AIME 2024-2025Accuracy87.2%Independentmedium7 Aug 2025Epoch AI
OTIS Mock AIME 2024-2025Accuracy46.7%Independentminimal20 Jul 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Aider PolyglotPercent correct88.0%Third partyhigh—https://aider.chat/docs/leaderboards/ via Epoch AI
Aider PolyglotPercent correct86.7%Third partymedium—https://aider.chat/docs/leaderboards/ via Epoch AI
Aider PolyglotPercent correct81.3%Third partylow—https://aider.chat/docs/leaderboards/ via Epoch AI
GSOOPT@16.9%Third partyhigh—https://gso-bench.github.io/index.html via Epoch AI
METR Time HorizonsAverage task success (Epoch's column)69.6%Third partymedium—METR - Measuring AI Ability to Complete Long Tasks via Epoch AI
METR Time HorizonsAverage task success (Epoch's column)69.4%Source not statedhigh—Epoch AI via Epoch AI
SWE-bench Verified% resolved73.6%Independenthigh6 Feb 2026Epoch AI
SWE-bench Verified% resolved71.5%Independentmedium5 Feb 2026Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)49.6%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)49.6%Third partymedium—Terminal-Bench v2 Leaderboard via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)43.8%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)43.8%Third partymedium—Terminal-Bench v2 Leaderboard via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)35.2%Third partymedium—Terminal-Bench v2 Leaderboard via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)35.2%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)33.9%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)33.9%Third partymedium—Terminal-Bench v2 Leaderboard via Epoch AI
WeirdML (v2)Average accuracy60.7%Third partyhigh—https://htihle.github.io/weirdml.html via Epoch AI

Agentic tool use

Agentic tool use results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
BALROGAverage progress32.8%Third partyminimal—https://balrogai.com/ via Epoch AI
Deep Research Bench (FutureSearch)Average score49.6%Third partylow—https://evals.futuresearch.ai/#drb via Epoch AI
Deep Research Bench (FutureSearch)Average score48.9%Third partyminimal—https://evals.futuresearch.ai/#drb via Epoch AI
Deep Research Bench (FutureSearch)Average score48.6%Third partymedium—https://evals.futuresearch.ai/#drb via Epoch AI
Deep Research Bench (FutureSearch)Average score48.1%Third partyhigh—https://evals.futuresearch.ai/#drb via Epoch AI

Professional knowledge work

Professional knowledge work results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GDPvalWins vs experts34.8%Source not statedmedium—Epoch AI via Epoch AI

Long context

Long context results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Fiction.LiveBench% correct at 16K tokens (Epoch's column)97.2%Third partymedium—Fiction.live leaderboard via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GeoBenchCountry accuracy81.0%Third partymedium—GeoBench leaderboard via Epoch AI
Visual Physics Comprehension Test (VPCT)Correct66.0%Third partyhigh—VPCT leaderboard via Epoch AI
Visual Physics Comprehension Test (VPCT)Correct63.2%Third partymedium—VPCT leaderboard via Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)50.1%Independenthigh27 Aug 2026Epoch AI

Writing

Writing results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
LLM Creative Story-Writing Benchmark V1 (Lech Mazur)Mean rubric score (percent of the 10-point scale)86.0%Third partymedium—lechmazur/writing Github repository via Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1418Independentmedium25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes3090Independentmedium25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1435Independenthigh25 Sep 2026Arena
Text Arena (arena.ai)Votes31503Independenthigh25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1210Independenthigh28 Sep 2026Arena
Vision Arena (arena.ai)Votes34464Independenthigh28 Sep 2026Arena

Other GPT-5 versions

Sources