supermarket

Language

Llama 3 70B

By Meta, in the Llama family.

Released
18 Apr 2024
Status
Legacy
Context
8.2K
Max output
—
Input per 1M tokens
—
Output per 1M tokens
—
Open weights
Yes
License
llama-3
Parameters
70.55B
Knowledge cutoff
Dec 2023
Reasoning
No
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Not enough independent results yet

Only independent and third-party results rank a model; self-reported and unattributed numbers never do.

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DTBench (Decision Theory Benchmark)Accuracy (capability questions)54.2%Third party——https://conceptualreasoning.ai/dtbench via Epoch AI
MMLUAccuracy79.3%Third party——Stanford CRFM Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy40.6%Independent—27 Jan 2025Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
MATH Level 5Accuracy22.6%Independent—27 Jan 2025Epoch AI
OTIS Mock AIME 2024-2025Accuracy4.3%Independent—25 Feb 2025Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
CybenchUnguided challenges solved5.0%Third party——Cybench leaderboard via Epoch AI

Other Llama versions

Sources