Updated daily at 05:00 UTC
- Released
- 15 Apr 2024
- Status
- Retired
- Context
- 65.5K
- Max output
- —
- Input per 1M tokens
- —
- Output per 1M tokens
- —
- Open weights
- Yes
- License
- apache-2.0
- Parameters
- 141B, 39B active
- Knowledge cutoff
- —
- Reasoning
- No
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
Not enough independent results yet
Only independent and third-party results rank a model; self-reported and unattributed numbers never do.
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 43.4% | Independent | — | 27 Jan 2025 | Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| MATH Level 5 | Accuracy | 25.7% | Independent | — | 27 Jan 2025 | Epoch AI |