Vision-language

Gemini 2.0 Flash

Released
11 Dec 2024
Status
Retired
Retired
1 Jun 2026
Context
1M
Max output
8.2K
Input per 1M tokens
$0.10
Output per 1M tokens
$0.40
Open weights
No
License
proprietary
Parameters
—
Knowledge cutoff
Aug 2024
Reasoning
No
Modalities
text, image, audio, video → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning2.7Not ranked1 of 4
Coding & software engineering22.2Not ranked1 of 5
Professional knowledge work11.471 of 1
Vision & multimodal understanding77.0Not ranked1 of 3
Human preference32.7Not ranked2 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DTBench (Decision Theory Benchmark)Accuracy (capability questions)63.2%Third party——https://conceptualreasoning.ai/dtbench via Epoch AI
MMLUAccuracy79.7%Third party——Stanford CRFM Leaderboard via Epoch AI
SimpleBenchScore (AVG@5)18.9%Third party——SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy64.1%Independent—6 Feb 2025Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
FrontierMath Tiers 1-3 (v1)Accuracy1.7%Independent—9 Mar 2025Epoch AI
MATH Level 5Accuracy82.2%Independent—6 Feb 2025Epoch AI
OTIS Mock AIME 2024-2025Accuracy31.1%Independent—25 Feb 2025Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Aider PolyglotPercent correct22.2%Third party——https://aider.chat/docs/leaderboards/ via Epoch AI
CadEvalOverall pass rate30.0%Third party——CadEval Dashboard via Epoch AI
WeirdML (v2)Average accuracy25.8%Third party——https://htihle.github.io/weirdml.html via Epoch AI

Professional knowledge work

Professional knowledge work results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
TheAgentCompanyTasks resolved11.4%Third party——TheAgentCompany experiment results github via Epoch AI

Long context

Long context results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Fiction.LiveBench% correct at 16K tokens (Epoch's column)61.1%Third party——Fiction.live leaderboard via Epoch AI

Vision & multimodal understanding

Vision & multimodal understanding results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GeoBenchCountry accuracy77.0%Third party——GeoBench leaderboard via Epoch AI

Writing

Writing results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
LLM Creative Story-Writing Benchmark V1 (Lech Mazur)Mean rubric score (percent of the 10-point scale)71.5%Third party——lechmazur/writing Github repository via Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Text Arena (arena.ai)Arena score (Elo scale)1360Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes43315Independent—25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1172Independent—28 Sep 2026Arena
Vision Arena (arena.ai)Votes10137Independent—28 Sep 2026Arena

Other Gemini Flash versions

Sources