Updated daily at 05:00 UTC
- Released
- 10 Mar 2025
- Status
- Legacy
- Context
- 131.1K
- Max output
- —
- Input per 1M tokens
- —
- Output per 1M tokens
- —
- Open weights
- Yes
- License
- gemma
- Parameters
- 27.43B
- Knowledge cutoff
- Aug 2024
- Reasoning
- No
- Modalities
- text, image → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
| Category | Score | Rank | Coverage |
|---|---|---|---|
| Knowledge & reasoning | 7.2 | 101 | 2 of 4 |
| Coding & software engineering | 4.9 | Not ranked | 1 of 5 |
| Vision & multimodal understanding | 52.0 | Not ranked | 1 of 3 |
| Human preference | 32.5 | Not ranked | 2 of 5 |
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Chess Puzzles | Puzzles solved | 0.0% | Independent | — | 27 Aug 2026 | Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 52.5% | Third party | — | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.1228 | Third party | — | — | https://conceptualreasoning.ai/lmca via Epoch AI |
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 47.7% | Independent | — | 27 Aug 2026 | Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| MATH Level 5 | Accuracy | 74.0% | Independent | — | 13 Mar 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 22.5% | Independent | — | 27 Aug 2026 | Epoch AI |
Coding & software engineering
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Aider Polyglot | Percent correct | 4.9% | Third party | — | — | https://aider.chat/docs/leaderboards/ via Epoch AI |
Long context
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Fiction.LiveBench | % correct at 16K tokens (Epoch's column) | 33.3% | Third party | — | — | Fiction.live leaderboard via Epoch AI |
Vision & multimodal understanding
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GeoBench | Country accuracy | 52.0% | Third party | — | — | GeoBench leaderboard via Epoch AI |
Writing
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| LLM Creative Story-Writing Benchmark V1 (Lech Mazur) | Mean rubric score (percent of the 10-point scale) | 79.9% | Third party | — | — | lechmazur/writing Github repository via Epoch AI |
Human preference
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Text Arena (arena.ai) | Arena score (Elo scale) | 1365 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 46433 | Independent | — | 25 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Arena score (Elo scale) | 1160 | Independent | — | 28 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Votes | 16991 | Independent | — | 28 Sep 2026 | Arena |
Other Gemma versions
- Gemma 4 12B Unified3 Jun 2026
- Gemma 4 26B A4B31 Mar 2026
- Gemma 4 31B31 Mar 2026
- Gemma 4 E2B31 Mar 2026
- Gemma 4 E4B31 Mar 2026
- Gemma 3 270M14 Aug 2025
- Gemma 3n E2B26 Jun 2025
- Gemma 3n E4B26 Jun 2025
- Gemma 3 12B10 Mar 2025
- Gemma 3 1B10 Mar 2025
- Gemma 3 4B10 Mar 2025
- Gemma 2 JPN 2B3 Oct 2024
- Gemma 2 2B31 Jul 2024
- Gemma 2 27B27 Jun 2024
- Gemma 2 9B27 Jun 2024
- Gemma 1.1 2B5 Apr 2024
- Gemma 1.1 7B5 Apr 2024
- Gemma 2B21 Feb 2024
- Gemma 7B21 Feb 2024