Released
23 Apr 2026
Status
Legacy
Context
1.1M
Max output
128K
Input per 1M tokens
$5.00
Output per 1M tokens
$30.00
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
Dec 2025
Reasoning
Yes
Modalities
text, image → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning45.8264 of 4
Coding & software engineering40.064 of 5
Agentic tool use54.0Not ranked1 of 2
Computer & browser use13.051 of 1
Vision & multimodal understanding20.2Not ranked1 of 3
Factuality & hallucination63.0121 of 1
Human preference52.5233 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved26.0%Independentlow7 Aug 2026Epoch AI
Chess PuzzlesPuzzles solved10.0%Independentnone7 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)96.0%Third partyxhigh—https://conceptualreasoning.ai/dtbench via Epoch AI
Earthborne Rangers (EBR-bench)Objectives reached34.3%Independentxhigh27 Jul 2026Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.5427Third partyxhigh—https://conceptualreasoning.ai/lmca via Epoch AI
Mystery Game PuzzlesPuzzles solved56.0%Independentxhigh24 Jul 2026Epoch AI
Mystery Game PuzzlesPuzzles solved52.0%Independenthigh27 Jul 2026Epoch AI
Mystery Game PuzzlesPuzzles solved28.0%Independentlow28 Aug 2026Epoch AI
Mystery Game PuzzlesPuzzles solved18.0%Independentnone27 Aug 2026Epoch AI
SimpleBenchScore (AVG@5)69.0%Third partyunknown—https://lmcouncil.ai/benchmarks via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy90.7%Independentlow5 May 2026Epoch AI
GPQA DiamondAccuracy77.3%Independentnone7 Aug 2026Epoch AI
Surface Evolver BenchMean score (partial credit)88.1%Third partyhigh—https://yhenon.github.io/surface-evolver-llm-eval/ via Epoch AI
Surface Evolver BenchMean score (partial credit)81.3%Third partymedium—https://yhenon.github.io/surface-evolver-llm-eval/ via Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4Accuracy72.5%Independentxhigh11 Jun 2026Epoch AI
FrontierMath Tiers 1-3Accuracy85.3%Independentxhigh11 Jun 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy84.4%Independentlow7 Aug 2026Epoch AI
OTIS Mock AIME 2024-2025Accuracy57.8%Independentnone7 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DeepSWEPass@167.0%Third partyxhigh—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@164.4%Third partyhigh—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@154.0%Third partymedium—https://deepswe.datacurve.ai/ via Epoch AI
DeepSWEPass@127.0%Third partylow—https://deepswe.datacurve.ai/ via Epoch AI
ExploitBenchMean capability47.4%Source not statedunknown—Epoch AI via Epoch AI
ExploitBenchMean capability41.8%Source not statedunknown—Epoch AI via Epoch AI
ExploitBenchMean capability41.6%Source not statedunknown—Epoch AI via Epoch AI
ExploitBenchMean capability32.6%Source not statedunknown—Epoch AI via Epoch AI
FrontierCodeMain score (Mean@5)43.0%Third partyunknown—https://cognition.com/frontiercode via Epoch AI
GSOOPT@140.2%Third partyxhigh—https://gso-bench.github.io/index.html via Epoch AI
MirrorCodeScore10.0%Independenthigh10 Aug 2026Epoch AI
PostTrainBenchAverage score27.2%Source not statedxhigh—Epoch AI via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)84.7%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)83.1%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)82.2%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)82.0%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)66.1%Third partyunknown—https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
WeirdML (v2)Average accuracy84.9%Third partyxhigh—https://htihle.github.io/weirdml.html via Epoch AI
WeirdML (v2)Average accuracy83.9%Third partyhigh—https://htihle.github.io/weirdml.html via Epoch AI
WeirdML (v2)Average accuracy67.2%Third partynone—https://htihle.github.io/weirdml.html via Epoch AI

Agentic tool use

Agentic tool use results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Deep Research Bench (FutureSearch)Average score54.0%Third partyhigh—https://evals.futuresearch.ai/#drb via Epoch AI
Deep Research Bench (FutureSearch)Average score49.6%Third partymedium—https://evals.futuresearch.ai/#drb via Epoch AI
Deep Research Bench (FutureSearch)Average score48.7%Third partylow—https://evals.futuresearch.ai/#drb via Epoch AI

Computer & browser use

Computer & browser use results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
OSWorld 2.0Binary completion (500 steps)13.0%Third partyxhigh—https://osworld-v2.xlang.ai/ via Epoch AI

Professional knowledge work

Professional knowledge work results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
APEX-AgentsPass@1 (all rubric criteria met)55.1%Source not statedunknown—Epoch AI via Epoch AI

Long context

Long context results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
CL-bench LifeTasks solved22.2%Source not statedhigh—Epoch AI via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Furniture AssemblyScore44.2%Independentxhigh10 Sep 2026Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
SimpleQA VerifiedAccuracy (% correct)63.0%Independentxhigh27 Aug 2026Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Document Arena (arena.ai)Arena score (Elo scale)1483Independent—13 Sep 2026Arena
Document Arena (arena.ai)Arena score (Elo scale)1480Independenthigh13 Sep 2026Arena
Document Arena (arena.ai)Votes21279Independent—13 Sep 2026Arena
Document Arena (arena.ai)Votes20944Independenthigh13 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1481Independenthigh25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1477Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes70635Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes69008Independenthigh25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1287Independent—28 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1281Independenthigh28 Sep 2026Arena
Vision Arena (arena.ai)Votes26870Independent—28 Sep 2026Arena
Vision Arena (arena.ai)Votes25170Independenthigh28 Sep 2026Arena

Other GPT-5 versions

Sources