Updated daily at 05:00 UTC
- Released
- 11 Jul 2023
- Status
- Retired
- Retired
- 21 Jul 2025
- Context
- 100K
- Max output
- 4.1K
- Input per 1M tokens
- $8.00
- Output per 1M tokens
- $24.00
- Open weights
- No
- License
- proprietary
- Parameters
- —
- Knowledge cutoff
- —
- Reasoning
- No
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
Not enough independent results yet
Only independent and third-party results rank a model; self-reported and unattributed numbers never do.
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 51.9% | Third party | — | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| MMLU | Accuracy | 78.5% | Self-reported | — | — | Model Card and Evaluations for Claude Models via Epoch AI |
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 34.7% | Independent | — | 27 Jan 2025 | Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| MATH Level 5 | Accuracy | 11.7% | Independent | — | 27 Jan 2025 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 2.5% | Independent | — | 7 Mar 2025 | Epoch AI |
Factuality & hallucination
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| TriviaQA | Exact match | 87.5% | Self-reported | — | — | Model Card and Evaluations for Claude Models via Epoch AI |
Other Claude versions
- Claude 2.121 Nov 2023
- Claude 114 Mar 2023