Updated daily at 05:00 UTC
- Released
- 15 Feb 2024
- Status
- Retired
- Retired
- 29 Sep 2025
- Context
- 2.1M
- Max output
- 8.2K
- Input per 1M tokens
- $1.25
- Output per 1M tokens
- $5.00
- Open weights
- No
- License
- proprietary
- Parameters
- —
- Knowledge cutoff
- Nov 2023
- Reasoning
- No
- Modalities
- text, image, audio, video → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
| Category | Score | Rank | Coverage |
|---|---|---|---|
| Knowledge & reasoning | 12.5 | Not ranked | 1 of 4 |
| Agentic tool use | 21.0 | Not ranked | 1 of 2 |
| Professional knowledge work | 3.4 | 12 | 1 of 1 |
| Human preference | 32.5 | Not ranked | 2 of 5 |
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| BIG-Bench Hard (BBH) | Average accuracy | 89.2% | Third party | — | — | Gemini 1.5 report via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 59.0% | Third party | — | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 56.5% | Third party | — | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| MMLU | Accuracy | 86.9% | Third party | — | — | Stanford CRFM Leaderboard via Epoch AI |
| MMLU | Accuracy | 85.9% | Third party | — | — | Gemini 1.5 Report via Epoch AI |
| SimpleBench | Score (AVG@5) | 27.1% | Third party | — | — | SimpleBench Leaderboard via Epoch AI |
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 57.2% | Independent | — | 27 Jan 2025 | Epoch AI |
| GPQA Diamond | Accuracy | 45.9% | Independent | — | 27 Jan 2025 | Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| MATH Level 5 | Accuracy | 70.4% | Independent | — | 27 Jan 2025 | Epoch AI |
| MATH Level 5 | Accuracy | 40.7% | Independent | — | 27 Jan 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 23.1% | Independent | — | 25 Feb 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 6.8% | Independent | — | 25 Feb 2025 | Epoch AI |
Coding & software engineering
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| CadEval | Overall pass rate | 34.0% | Third party | — | — | CadEval Dashboard via Epoch AI |
| WeirdML (v2) | Average accuracy | 22.2% | Third party | — | — | https://htihle.github.io/weirdml.html via Epoch AI |
Agentic tool use
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| BALROG | Average progress | 21.0% | Third party | — | — | https://balrogai.com/ via Epoch AI |
Professional knowledge work
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| TheAgentCompany | Tasks resolved | 3.4% | Third party | — | — | TheAgentCompany experiment results github via Epoch AI |
Human preference
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Text Arena (arena.ai) | Arena score (Elo scale) | 1351 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Arena score (Elo scale) | 1324 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 79138 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 55606 | Independent | — | 25 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Arena score (Elo scale) | 1179 | Independent | — | 28 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Arena score (Elo scale) | 1120 | Independent | — | 28 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Votes | 16734 | Independent | — | 28 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Votes | 8902 | Independent | — | 28 Sep 2026 | Arena |
Other Gemini Pro versions
- Gemini 3.1 Pro19 Feb 2026
- Gemini 3 Pro18 Nov 2025
- Gemini 2.5 Pro25 Mar 2025
- Gemini 2.0 Pro6 Dec 2024
- Gemini 1.0 Pro Vision13 Dec 2023
- Gemini 1.0 Pro6 Dec 2023
Sources
- https://web.archive.org/web/20250228132259/https://ai.google.dev/gemini-api/docs/models/gemini
- https://web.archive.org/web/20240531054813/https://ai.google.dev/gemini-api/docs/models/gemini
- https://web.archive.org/web/20250314171448/https://ai.google.dev/gemini-api/docs/pricing
- https://web.archive.org/web/20250124083859/https://ai.google.dev/gemini-api/docs/models/experimental-models
- https://ai.google.dev/gemini-api/docs/changelog
- https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions
- https://blog.google/innovation-and-ai/products/google-gemini-next-generation-model-february-2024/