supermarket

Vision-language

Gemma 4 26B A4B

By Google DeepMind, in the Gemma family.

Released
31 Mar 2026
Status
Current
Context
262.1K
Max output
—
Input per 1M tokens
—
Output per 1M tokens
—
Open weights
Yes
License
apache-2.0
Parameters
25.2B, 3.8B active
Knowledge cutoff
Jan 2025
Reasoning
Yes
Modalities
text, image, video → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning18.0822 of 4
Human preference42.7403 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Chess PuzzlesPuzzles solved6.0%Independentminimal6 Aug 2026Epoch AI
DTBench (Decision Theory Benchmark)Accuracy (capability questions)74.9%Third party——https://conceptualreasoning.ai/dtbench via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.2968Third party——https://conceptualreasoning.ai/lmca via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy73.2%Independentminimal6 Aug 2026Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
OTIS Mock AIME 2024-2025Accuracy82.2%Independentminimal28 Aug 2026Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
WeirdML (v2)Average accuracy35.2%Third party——https://htihle.github.io/weirdml.html via Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Code Arena: WebDev (arena.ai)Arena score (Elo scale)1358Independent—25 Sep 2026Arena
Code Arena: WebDev (arena.ai)Votes1505Independent—25 Sep 2026Arena
Text Arena (arena.ai)Arena score (Elo scale)1438Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes6078Independent—25 Sep 2026Arena
Vision Arena (arena.ai)Arena score (Elo scale)1242Independent—28 Sep 2026Arena
Vision Arena (arena.ai)Votes23977Independent—28 Sep 2026Arena

Other Gemma versions

Sources