Updated daily at 05:00 UTC
- Released
- 24 Jul 2024
- Status
- Retired
- Retired
- 30 Mar 2025
- Context
- 131.1K
- Max output
- —
- Input per 1M tokens
- —
- Output per 1M tokens
- —
- Open weights
- Yes
- License
- mistral-research-license
- Parameters
- 123B
- Knowledge cutoff
- —
- Reasoning
- No
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
| Category | Score | Rank | Coverage |
|---|---|---|---|
| Knowledge & reasoning | 7.0 | Not ranked | 1 of 4 |
| Human preference | 37.9 | Not ranked | 1 of 5 |
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 61.2% | Third party | — | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| MMLU | Accuracy | 80.0% | Third party | — | — | Stanford CRFM Leaderboard via Epoch AI |
| MMLU-Pro | Accuracy | 65.9% | Self-reported | — | — | EvalEval via Hugging Face Community Evals |
| SimpleBench | Score (AVG@5) | 22.5% | Third party | — | — | SimpleBench Leaderboard via Epoch AI |
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 49.0% | Independent | — | 27 Jan 2025 | Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| MATH Level 5 | Accuracy | 44.8% | Independent | — | 27 Jan 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 8.5% | Independent | — | 25 Feb 2025 | Epoch AI |
Writing
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| LLM Creative Story-Writing Benchmark V1 (Lech Mazur) | Mean rubric score (percent of the 10-point scale) | 69.0% | Third party | — | — | lechmazur/writing Github repository via Epoch AI |
Human preference
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Text Arena (arena.ai) | Arena score (Elo scale) | 1314 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 45459 | Independent | — | 25 Sep 2026 | Arena |
Other Mistral Large versions
- Mistral Large 32 Dec 2025
- Mistral Large 2.118 Nov 2024
- Mistral Large 1.026 Feb 2024