Released
18 Nov 2025
Status
Retired
Retired
9 Mar 2026
Context
1M
Max output
65.5K
Input per 1M tokens
$2.00
Output per 1M tokens
$12.00
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
Jan 2025
Reasoning
Yes
Modalities
text, image, video, audio, pdf → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning49.5172 of 4
Coding & software engineering18.6Not ranked1 of 5
Agentic tool use52.222 of 2
Vision & multimodal understanding85.212 of 3
Human preference52.4244 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved31.0%Independent—8 Dec 2025Epoch AI
SimpleBenchScore (AVG@5)76.4%Third party——https://lmcouncil.ai/benchmarks via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy92.6%Independent—19 Nov 2025Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tier 4 (v1)Accuracy18.8%Independent—21 Nov 2025Epoch AI
FrontierMath Tiers 1-3 (v1)Accuracy37.6%Independent—21 Nov 2025Epoch AI
OTIS Mock AIME 2024-2025Accuracy91.4%Independent—19 Nov 2025Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GSOOPT@118.6%Third party——https://gso-bench.github.io/index.html via Epoch AI
METR Time HorizonsAverage task success (Epoch's column)71.0%Source not stated——Epoch AI via Epoch AI
SWE-bench Verified% resolved72.9%Independent—13 Feb 2026Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)69.4%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)65.2%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)62.2%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)61.8%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)61.1%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)56.9%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)56.0%Third party——https://www.tbench.ai/leaderboard/terminal-bench/2.0 via Epoch AI
Terminal-Bench 2.0Accuracy (mean over trials)62.2%Source not stated——Epoch AI via Epoch AI
WeirdML (v2)Average accuracy69.9%Third party——https://htihle.github.io/weirdml.html via Epoch AI

Agentic tool use

Agentic tool use results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
BALROGAverage progress58.1%Third party——https://balrogai.com/ via Epoch AI
Deep Research Bench (FutureSearch)Average score46.3%Third partylow—https://evals.futuresearch.ai/#drb via Epoch AI

Professional knowledge work

Professional knowledge work results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GDPvalWins vs experts40.3%Source not stated——Epoch AI via Epoch AI

Long context

Long context results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
CL-benchTasks solved15.8%Source not stated——Epoch AI via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GeoBenchCountry accuracy84.0%Third party——GeoBench leaderboard via Epoch AI
Visual Physics Comprehension Test (VPCT)Correct91.0%Third party——VPCT leaderboard via Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1439Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes14103Independent—25 Sep 2026Arena
Document Arena (arena.ai)Arena score (Elo scale)1451Independent—13 Sep 2026Arena
Document Arena (arena.ai)Votes10769Independent—13 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1485Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes41921Independent—25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1289Independent—28 Sep 2026Arena
Vision Arena (arena.ai)Votes13624Independent—28 Sep 2026Arena

Other Gemini Pro versions

Sources