Updated daily at 05:00 UTC
Vision-language
GPT-5.6 Sol
- Released
- 9 Jul 2026
- Status
- Current
- Context
- 1.1M
- Max output
- 128K
- Input per 1M tokens
- $4.00
- Output per 1M tokens
- $20.00
- Open weights
- No
- License
- proprietary
- Parameters
- —
- Knowledge cutoff
- 16 Feb 2026
- Reasoning
- Yes
- Modalities
- text, image → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
| Category | Score | Rank | Coverage |
|---|---|---|---|
| Knowledge & reasoning | 60.6 | 7 | 4 of 4 |
| Coding & software engineering | 46.7 | 4 | 3 of 5 |
| Agentic tool use | 60.0 | Not ranked | 1 of 2 |
| Computer & browser use | 27.3 | 2 | 1 of 1 |
| Vision & multimodal understanding | 38.1 | Not ranked | 1 of 3 |
| Factuality & hallucination | 69.7 | 6 | 1 of 1 |
| Human preference | 47.2 | 36 | 4 of 5 |
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Chess Puzzles | Puzzles solved | 64.0% | Independent | promax | 10 Jul 2026 | Epoch AI |
| Chess Puzzles | Puzzles solved | 55.0% | Independent | max | 9 Jul 2026 | Epoch AI |
| Chess Puzzles | Puzzles solved | 27.0% | Independent | low | 7 Aug 2026 | Epoch AI |
| Chess Puzzles | Puzzles solved | 7.0% | Independent | none | 7 Aug 2026 | Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 96.0% | Third party | promax | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 95.7% | Third party | xhigh | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 95.5% | Third party | max | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 95.5% | Third party | high | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 95.2% | Third party | medium | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 93.9% | Third party | low | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| DTBench (Decision Theory Benchmark) | Accuracy (capability questions) | 83.7% | Third party | none | — | https://conceptualreasoning.ai/dtbench via Epoch AI |
| Earthborne Rangers (EBR-bench) | Objectives reached | 44.8% | Independent | max | 4 Sep 2026 | Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.5921 | Third party | promax | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.5849 | Third party | xhigh | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.5843 | Third party | max | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.5694 | Third party | high | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.564 | Third party | medium | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.5589 | Third party | low | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| LMCA (Language Model Conceptual Argumentation) | Correlation with expert ratings (Pearson r) | 0.5275 | Third party | none | — | https://conceptualreasoning.ai/lmca via Epoch AI |
| Mystery Game Puzzles | Puzzles solved | 58.0% | Independent | max | 28 Jul 2026 | Epoch AI |
| Mystery Game Puzzles | Puzzles solved | 33.0% | Independent | none | 27 Aug 2026 | Epoch AI |
| Mystery Game Puzzles | Puzzles solved | 26.0% | Independent | low | 27 Aug 2026 | Epoch AI |
| SimpleBench | Score (AVG@5) | 71.7% | Third party | proxhigh | — | https://lmcouncil.ai/benchmarks via Epoch AI |
| SimpleBench | Score (AVG@5) | 71.7% | Third party | prounknown | — | SimpleBench Leaderboard via Epoch AI |
| SimpleBench | Score (AVG@5) | 64.8% | Third party | xhigh | — | https://lmcouncil.ai/benchmarks via Epoch AI |
| SimpleBench | Score (AVG@5) | 64.8% | Third party | unknown | — | SimpleBench Leaderboard via Epoch AI |
Scientific reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GPQA Diamond | Accuracy | 93.5% | Independent | max | 9 Jul 2026 | Epoch AI |
| GPQA Diamond | Accuracy | 89.9% | Independent | low | 7 Aug 2026 | Epoch AI |
| GPQA Diamond | Accuracy | 82.8% | Independent | none | 7 Aug 2026 | Epoch AI |
| Surface Evolver Bench | Mean score (partial credit) | 93.1% | Third party | xhigh | — | https://yhenon.github.io/surface-evolver-llm-eval/ via Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| FrontierMath Tier 4 | Accuracy | 82.9% | Independent | max | 9 Jul 2026 | Epoch AI |
| FrontierMath Tier 4 | Accuracy | 80.5% | Independent | promax | 9 Jul 2026 | Epoch AI |
| FrontierMath Tiers 1-3 | Accuracy | 89.1% | Independent | max | 9 Jul 2026 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 100.0% | Independent | max | 9 Jul 2026 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 95.6% | Independent | low | 7 Aug 2026 | Epoch AI |
| OTIS Mock AIME 2024-2025 | Accuracy | 68.9% | Independent | none | 7 Aug 2026 | Epoch AI |
Coding & software engineering
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| DeepSWE | Pass@1 | 72.7% | Third party | max | — | https://deepswe.datacurve.ai/ via Epoch AI |
| DeepSWE | Pass@1 | 70.7% | Third party | xhigh | — | https://deepswe.datacurve.ai/ via Epoch AI |
| DeepSWE | Pass@1 | 69.4% | Third party | high | — | https://deepswe.datacurve.ai/ via Epoch AI |
| DeepSWE | Pass@1 | 61.1% | Third party | medium | — | https://deepswe.datacurve.ai/ via Epoch AI |
| DeepSWE | Pass@1 | 45.4% | Third party | low | — | https://deepswe.datacurve.ai/ via Epoch AI |
| FrontierCode | Main score (Mean@5) | 47.5% | Third party | unknown | — | https://cognition.com/frontiercode via Epoch AI |
| MirrorCode | Score | 20.0% | Independent | high | 10 Aug 2026 | Epoch AI |
| PostTrainBench | Average score | 36.2% | Source not stated | max | — | Epoch AI via Epoch AI |
| WeirdML (v2) | Average accuracy | 89.4% | Third party | promax | — | https://htihle.github.io/weirdml.html via Epoch AI |
| WeirdML (v2) | Average accuracy | 88.8% | Third party | high | — | https://htihle.github.io/weirdml.html via Epoch AI |
| WeirdML (v2) | Average accuracy | 87.0% | Third party | max | — | https://htihle.github.io/weirdml.html via Epoch AI |
Agentic tool use
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| BALROG | Average progress | 60.0% | Third party | max | — | https://balrogai.com/ via Epoch AI |
Computer & browser use
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| OSWorld 2.0 | Binary completion (500 steps) | 27.3% | Third party | max | — | https://osworld-v2.xlang.ai/ via Epoch AI |
Professional knowledge work
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| APEX-Agents | Pass@1 (all rubric criteria met) | 51.4% | Source not stated | promax | — | Epoch AI via Epoch AI |
Vision & multimodal understanding
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Furniture Assembly | Score | 56.7% | Independent | max | 10 Sep 2026 | Epoch AI |
Factuality & hallucination
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| SimpleQA Verified | Accuracy (% correct) | 69.7% | Independent | max | 10 Aug 2026 | Epoch AI |
Human preference
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Document Arena (arena.ai) | Arena score (Elo scale) | 1489 | Independent | xhigh | 13 Sep 2026 | Arena |
| Document Arena (arena.ai) | Votes | 4818 | Independent | xhigh | 13 Sep 2026 | Arena |
| Search Arena (arena.ai) | Arena score (Elo scale) | 1256 | Independent | xhigh | 24 Aug 2026 | Arena |
| Search Arena (arena.ai) | Votes | 29663 | Independent | xhigh | 24 Aug 2026 | Arena |
| Text Arena (arena.ai) | Arena score (Elo scale) | 1483 | Independent | xhigh | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 34258 | Independent | xhigh | 25 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Arena score (Elo scale) | 1287 | Independent | xhigh | 28 Sep 2026 | Arena |
| Vision Arena (arena.ai) | Votes | 10063 | Independent | xhigh | 28 Sep 2026 | Arena |
Other GPT-5 versions
- GPT-5.6 Cyber10 Aug 2026
- GPT-5.6 Luna9 Jul 2026
- GPT-5.6 Terra9 Jul 2026
- GPT-5.523 Apr 2026
- GPT-5.5 Pro23 Apr 2026
- GPT-5.4 mini17 Mar 2026
- GPT-5.4 nano17 Mar 2026
- GPT-5.45 Mar 2026
- GPT-5.4 Pro5 Mar 2026
- GPT-5.3 Instant (gpt-5.3-chat-latest)3 Mar 2026
- GPT-5.211 Dec 2025
- GPT-5.2 Instant (gpt-5.2-chat-latest)11 Dec 2025
- GPT-5.2 Pro11 Dec 2025
- GPT-5.112 Nov 2025
- GPT-5.1 Instant (gpt-5.1-chat-latest)12 Nov 2025
- GPT-57 Aug 2025
- GPT-5 Instant (gpt-5-chat-latest)7 Aug 2025
- GPT-5 mini7 Aug 2025
- GPT-5 nano7 Aug 2025
- GPT-5 Pro7 Aug 2025
- GPT-5.4 Cyber—
- GPT-5.5 Cyber—