Updated daily at 05:00 UTC
- Released
- 28 Nov 2022
- Status
- Retired
- Retired
- 4 Jan 2024
- Context
- —
- Max output
- —
- Input per 1M tokens
- $20.00
- Output per 1M tokens
- $20.00
- Open weights
- No
- License
- proprietary
- Parameters
- —
- Knowledge cutoff
- —
- Reasoning
- No
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
Not enough independent results yet
Only independent and third-party results rank a model; self-reported and unattributed numbers never do.
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| HellaSwag | Accuracy | 85.5% | Third party | — | — | The Falcon Series of Open Language Models via Epoch AI |
| HellaSwag | Accuracy | 82.2% | Third party | — | — | Stanford HELM via Epoch AI |
| HellaSwag | Accuracy | 85.5% | Self-reported | — | — | GPT-4 Technical Report via Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GSM8K | Exact match | 57.1% | Third party | — | — | Yi: Open Foundation Models by 01.AI via Epoch AI |
| GSM8K | Exact match | 50.6% | Third party | — | — | Stanford HELM via Epoch AI |
| GSM8K | Exact match | 78.2% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| GSM8K | Exact match | 57.1% | Self-reported | — | — | GPT-4 Technical Report via Epoch AI |
Other GPT-3.5 versions
- GPT-3.5 Turbo Instruct18 Sep 2023
- GPT-3.5 Turbo 16k13 Jun 2023
- GPT-3.5 Turbo1 Mar 2023
- text-davinci-00215 Mar 2022