Updated daily at 05:00 UTC
- Released
- 20 Jul 2023
- Status
- Legacy
- Context
- 4.1K
- Max output
- —
- Input per 1M tokens
- —
- Output per 1M tokens
- —
- Open weights
- Yes
- License
- llama-2
- Parameters
- 70B
- Knowledge cutoff
- —
- Reasoning
- No
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
Not enough independent results yet
Only independent and third-party results rank a model; self-reported and unattributed numbers never do.
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| AI2 Reasoning Challenge (ARC) | Challenge set accuracy | 86.1% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| BIG-Bench Hard (BBH) | Average accuracy | 69.3% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| HellaSwag | Accuracy | 84.1% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| LAMBADA | Accuracy | 71.3% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| LAMBADA | Accuracy | 71.3% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| MMLU | Accuracy | 68.6% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| PIQA | Accuracy | 83.3% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GSM8K | Exact match | 69.6% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
Other StableLM versions
- StableLM 2 12B8 Apr 2024
- StableLM 2 1.6B19 Jan 2024
- StableLM Zephyr 3B21 Nov 2023
- StableLM-3B-4E1T29 Sep 2023
- StableLM-Alpha 3B19 Apr 2023
- StableLM-Alpha 7B19 Apr 2023