Updated daily at 05:00 UTC
- Released
- 12 Sep 2024
- Status
- Retired
- Retired
- 27 Oct 2025
- Context
- 128K
- Max output
- 65.5K
- Input per 1M tokens
- $1.10
- Output per 1M tokens
- $4.40
- Open weights
- No
- License
- proprietary
- Parameters
- —
- Knowledge cutoff
- Oct 2023
- Reasoning
- Yes
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
| Category | Score | Rank | Coverage |
|---|---|---|---|
| Knowledge & reasoning | 1.7 | Not ranked | 1 of 4 |
| Coding & software engineering | 32.9 | Not ranked | 1 of 5 |
| Human preference | 41.0 | Not ranked | 1 of 5 |
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| SimpleBench | Score (AVG@5) | 18.1% | Third party | medium | — | SimpleBench Leaderboard via Epoch AI |
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 62.4% | Independent | high | 13 Feb 2025 | Epoch AI |
| GPQA Diamond | Accuracy | 59.5% | Independent | medium | 27 Jan 2025 | Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| FrontierMath Tiers 1-3 (v1) | Accuracy | 1.7% | Independent | medium | 6 Mar 2025 | Epoch AI |
| FrontierMath Tiers 1-3 (v1) | Accuracy | 1.4% | Independent | high | 6 Mar 2025 | Epoch AI |
| MATH Level 5 | Accuracy | 89.2% | Independent | high | 13 Feb 2025 | Epoch AI |
| MATH Level 5 | Accuracy | 84.3% | Independent | medium | 27 Jan 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 46.9% | Independent | high | 6 Mar 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 44.7% | Independent | medium | 6 Mar 2025 | Epoch AI |
Coding & software engineering
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Aider Polyglot | Percent correct | 32.9% | Third party | unknown | — | https://aider.chat/docs/leaderboards/ via Epoch AI |
| Cybench | Unguided challenges solved | 10.0% | Third party | medium | — | Cybench leaderboard via Epoch AI |
| WeirdML (v2) | Average accuracy | 36.3% | Third party | medium | — | https://htihle.github.io/weirdml.html via Epoch AI |
Writing
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| LLM Creative Story-Writing Benchmark V1 (Lech Mazur) | Mean rubric score (percent of the 10-point scale) | 64.9% | Third party | medium | — | lechmazur/writing Github repository via Epoch AI |
Human preference
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Text Arena (arena.ai) | Arena score (Elo scale) | 1337 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 51981 | Independent | — | 25 Sep 2026 | Arena |
Other o1 versions
- o1-pro19 Mar 2025
- o15 Dec 2024
- o1-preview12 Sep 2024