Updated daily at 05:00 UTC
Benchmark
GPQA Diamond
Measures: The hardest subset of GPQA's graduate-level, 'Google-proof' multiple-choice questions in biology, physics and chemistry written by domain experts; scored as accuracy (random guess 25%).
- Maintainer
- GPQA authors (Rein et al.); no official leaderboard. Independent runs by Epoch AI and Artificial Analysis
- Introduced
- 2023
- Status
- Active
- Saturation
- Saturated
- Typical provenance
- Mixed
- In scoring set
- No
Leaderboard
Independent and third-party results only.
| Model | Accuracy | Provenance | Source | Evaluated |
|---|---|---|---|---|
| DeepSeek-R1-0528-Qwen3-8B | 9.3% | Independent | Epoch AI | 28 Aug 2026 |
| Granite 4.0 350M (Nano) | 11.2% | Independent | Epoch AI | 28 Aug 2026 |
| Mistral 7B v0.3 | 13.2% | Independent | Epoch AI | 27 Jan 2025 |
| Yi-34B-Chat | 14.7% | Independent | Epoch AI | 27 Jan 2025 |
| Mistral 7B v0.3 | 15.2% | Independent | Epoch AI | 27 Jan 2025 |
| Gemma 3 1B | 19.9% | Independent | Epoch AI | 28 Aug 2026 |
| Gemma 3 4B | 23.2% | Independent | Epoch AI | 28 Aug 2026 |
| Llama 3.2 1B | 23.9% | Independent | Epoch AI | 30 Aug 2026 |
| Granite 4.0 1B (Nano) | 24.0% | Independent | Epoch AI | 28 Aug 2026 |
| DeepSeek LLM 67B Chat | 24.6% | Independent | Epoch AI | 27 Jan 2025 |
| Ministral 3B | 25.3% | Independent | Epoch AI | 27 Jan 2025 |
| Llama 3 8B | 26.1% | Independent | Epoch AI | 27 Jan 2025 |
| Llama 2 70B | 26.3% | Independent | Epoch AI | 27 Jan 2025 |
| Llama 3.1 8B | 27.0% | Independent | Epoch AI | 27 Aug 2026 |
| Ministral 8B | 27.1% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-3.5 Turbo | 27.2% | Independent | Epoch AI | 27 Jan 2025 |
| Gemma 2 9B | 27.5% | Independent | Epoch AI | 27 Jan 2025 |
| Phi-3-medium | 27.6% | Independent | Epoch AI | 31 Jan 2025 |
| GPT-3.5 Turbo | 28.0% | Independent | Epoch AI | 27 Jan 2025 |
| Granite 4.0 Micro (3B) | 28.3% | Independent | Epoch AI | 30 Aug 2026 |
| Qwen1.5-72B-Chat | 28.8% | Independent | Epoch AI | 27 Jan 2025 |
| Mixtral 8x7B | 29.8% | Independent | Epoch AI | 27 Jan 2025 |
| Mistral NeMo 12B | 29.9% | Independent | Epoch AI | 27 Jan 2025 |
| Mixtral 8x7B | 30.6% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen3-1.7B Alibaba Group · None effort | 30.6% | Independent | Epoch AI | 28 Aug 2026 |
| GPT-4 | 30.7% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen1.5-32B-Chat | 30.7% | Independent | Epoch AI | 27 Jan 2025 |
| Yi-1.5-34B-Chat | 32.0% | Independent | Epoch AI | 27 Jan 2025 |
| DBRX Instruct | 32.9% | Independent | Epoch AI | 27 Jan 2025 |
| Claude 2.1 | 33.0% | Independent | Epoch AI | 27 Jan 2025 |
| Gemini 1.5 Flash-8B | 33.0% | Independent | Epoch AI | 12 Mar 2025 |
| DeepSeek-R1-Distill-Qwen-1.5B | 33.6% | Independent | Epoch AI | 28 Aug 2026 |
| Gemini 1.0 Pro | 34.0% | Independent | Epoch AI | 27 Jan 2025 |
| Mixtral 8x22B | 34.1% | Independent | Epoch AI | 27 Jan 2025 |
| Claude 2 | 34.7% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen2.5-7B-Instruct | 35.5% | Independent | Epoch AI | 30 Aug 2026 |
| GPT-4 | 35.7% | Independent | Epoch AI | 23 Oct 2025 |
| Claude 3 Haiku | 36.3% | Independent | Epoch AI | 27 Jan 2025 |
| Gemma 2 27B | 36.5% | Independent | Epoch AI | 27 Jan 2025 |
| Hermes 2 Theta Llama 3 70B | 37.5% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-4o mini | 37.7% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen3-1.7B | 38.0% | Independent | Epoch AI | 28 Aug 2026 |
| Claude 3.5 Haiku | 38.1% | Independent | Epoch AI | 12 Mar 2025 |
| Mistral Large 1.0 | 38.8% | Independent | Epoch AI | 27 Jan 2025 |
| Gemma 3 12B | 39.5% | Independent | Epoch AI | 28 Aug 2026 |
| Gemini 1.5 Flash | 40.4% | Independent | Epoch AI | 27 Jan 2025 |
| Llama 3 70B | 40.6% | Independent | Epoch AI | 27 Jan 2025 |
| Claude 3 Sonnet | 40.6% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen2-72B-Instruct | 40.8% | Independent | Epoch AI | 27 Jan 2025 |
| Llama 3.2 90B Vision | 41.0% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen-Turbo | 41.8% | Independent | Epoch AI | 7 Apr 2025 |
| GPT-4 Turbo | 42.3% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-4 Turbo | 42.4% | Independent | Epoch AI | 27 Jan 2025 |
| WizardLM-2 8x22B | 43.4% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen3-4B Alibaba Group · None effort | 43.6% | Independent | Epoch AI | 28 Aug 2026 |
| Llama 3.1 70B | 44.2% | Independent | Epoch AI | 27 Jan 2025 |
| DeepSeek-R1-Distill-Qwen-14B | 44.7% | Independent | Epoch AI | 10 Mar 2025 |
| GLM-4.7-Flash Z.ai (Zhipu AI) · None effort | 45.1% | Independent | Epoch AI | 30 Aug 2026 |
| Mistral Small 3.0 | 45.3% | Independent | Epoch AI | 30 Jan 2025 |
| Qwen3-4B-Instruct-2507 | 45.8% | Independent | Epoch AI | 28 Aug 2026 |
| Gemini 1.5 Pro | 45.9% | Independent | Epoch AI | 27 Jan 2025 |
| gpt-oss-20b OpenAI · High effort | 46.0% | Independent | Epoch AI | 6 Aug 2026 |
| Qwen2.5-32B-Instruct | 46.1% | Independent | Epoch AI | 30 Jan 2025 |
| GPT-4 Turbo | 46.6% | Independent | Epoch AI | 27 Feb 2025 |
| Claude 3 Opus | 47.2% | Independent | Epoch AI | 27 Jan 2025 |
| Gemini 1.5 Flash | 47.3% | Independent | Epoch AI | 27 Jan 2025 |
| Llama 3.3 70B | 47.4% | Independent | Epoch AI | 27 Jan 2025 |
| Mistral Small 3.1 | 47.5% | Independent | Epoch AI | 18 Mar 2025 |
| Qwen3-8B Alibaba Group · None effort | 47.5% | Independent | Epoch AI | 27 Aug 2026 |
| Magistral Small 1.2 | 47.6% | Independent | Epoch AI | 30 Aug 2026 |
| Gemma 3 27B | 47.7% | Independent | Epoch AI | 27 Aug 2026 |
| GPT-4o | 47.9% | Independent | Epoch AI | 5 Feb 2025 |
| Qwen-Plus | 48.1% | Independent | Epoch AI | 7 Apr 2025 |
| GPT-5 nano OpenAI · Minimal effort | 48.5% | Independent | Epoch AI | 13 Jul 2026 |
| GPT-4o | 48.9% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-4.1 nano | 48.9% | Independent | Epoch AI | 14 Apr 2025 |
| Mistral Large 2.0 | 49.0% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen2.5-72B-Instruct | 49.1% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-4o | 49.2% | Independent | Epoch AI | 27 Jan 2025 |
| o1-preview | 50.3% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen3-30B-A3B Alibaba Group · None effort | 50.4% | Independent | Epoch AI | 30 Aug 2026 |
| Llama 3.1 405B | 50.9% | Independent | Epoch AI | 27 Jan 2025 |
| Mistral Large 2.1 | 51.3% | Independent | Epoch AI | 25 Feb 2025 |
| Llama 4 Scout | 51.8% | Independent | Epoch AI | 8 Apr 2025 |
| Qwen3-4B | 52.3% | Independent | Epoch AI | 28 Aug 2026 |
| gpt-oss-20b OpenAI · Low effort | 53.2% | Independent | Epoch AI | 27 Aug 2026 |
| Qwen3-14B Alibaba Group · None effort | 53.4% | Independent | Epoch AI | 28 Aug 2026 |
| Grok 2 | 53.8% | Independent | Epoch AI | 27 Jan 2025 |
| Claude 3.5 Sonnet | 54.0% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen3-32B Alibaba Group · None effort | 54.1% | Independent | Epoch AI | 30 Aug 2026 |
| Claude 3.5 Sonnet | 55.3% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-5.4 nano OpenAI · None effort | 55.6% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3-30B-A3B-Instruct-2507 | 55.6% | Independent | Epoch AI | 30 Aug 2026 |
| DeepSeek-R1-Distill-Llama-70B | 55.7% | Independent | Epoch AI | 10 Mar 2025 |
| Magistral Small 1.0 | 56.1% | Independent | Epoch AI | 6 Aug 2026 |
| Phi-4 | 56.1% | Independent | Epoch AI | 31 Jan 2025 |
| Qwen2.5-Max | 56.1% | Independent | Epoch AI | 1 Apr 2025 |
| DeepSeek-V3 | 56.5% | Independent | Epoch AI | 27 Jan 2025 |
| Qwen3-8B | 56.8% | Independent | Epoch AI | 27 Aug 2026 |
| Gemini 2.0 Flash Thinking | 57.1% | Independent | Epoch AI | 6 Feb 2025 |
| Gemini 1.5 Pro | 57.2% | Independent | Epoch AI | 27 Jan 2025 |
| GPT-5 nano OpenAI · Low effort | 57.6% | Independent | Epoch AI | 13 Jul 2026 |
| o1-mini OpenAI · Medium effort | 59.5% | Independent | Epoch AI | 27 Jan 2025 |
| Mistral Medium 3 | 59.5% | Independent | Epoch AI | 7 May 2025 |
| Claude Haiku 4.5 | 60.5% | Independent | Epoch AI | 16 Oct 2025 |
| GLM-4.7-Flash | 60.5% | Independent | Epoch AI | 30 Aug 2026 |
| gpt-oss-20b OpenAI · Medium effort | 60.8% | Independent | Epoch AI | 27 Aug 2026 |
| Qwen3-30B-A3B | 61.7% | Independent | Epoch AI | 30 Aug 2026 |
| o1-mini OpenAI · High effort | 62.4% | Independent | Epoch AI | 13 Feb 2025 |
| GPT-5.6 Luna OpenAI · None effort | 63.6% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3-14B | 63.8% | Independent | Epoch AI | 28 Aug 2026 |
| DeepSeek-R1-Distill-Qwen-32B | 64.1% | Independent | Epoch AI | 28 Aug 2026 |
| Gemini 2.0 Flash | 64.1% | Independent | Epoch AI | 6 Feb 2025 |
| GPT-5.4 mini OpenAI · None effort | 64.1% | Independent | Epoch AI | 7 Aug 2026 |
| QwQ-32B | 65.3% | Independent | Epoch AI | 28 Aug 2026 |
| QwQ-Plus | 65.4% | Independent | Epoch AI | 11 Apr 2025 |
| Gemini 2.0 Pro | 65.7% | Independent | Epoch AI | 7 Feb 2025 |
| Qwen3-32B | 65.7% | Independent | Epoch AI | 28 Aug 2026 |
| GPT-4.1 mini | 65.8% | Independent | Epoch AI | 14 Apr 2025 |
| Claude 3.7 Sonnet | 66.0% | Independent | Epoch AI | 24 Feb 2025 |
| Claude Sonnet 4 | 66.7% | Independent | Epoch AI | 22 May 2025 |
| Gemini 2.5 Pro | 66.7% | Independent | Epoch AI | 3 Jun 2025 |
| GPT-5.1 OpenAI · None effort | 66.7% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-4.1 | 66.9% | Independent | Epoch AI | 14 Apr 2025 |
| Llama 4 Maverick | 67.0% | Independent | Epoch AI | 8 Apr 2025 |
| GPT-5 nano OpenAI · Medium effort | 67.4% | Independent | Epoch AI | 7 Aug 2025 |
| o3-mini OpenAI · Low effort | 68.2% | Independent | Epoch AI | 20 Jul 2026 |
| GPT-4.5 | 68.7% | Independent | Epoch AI | 28 Feb 2025 |
| Claude Opus 4 | 69.2% | Independent | Epoch AI | 22 May 2025 |
| GPT-5 nano OpenAI · High effort | 69.4% | Independent | Epoch AI | 30 Oct 2025 |
| Qwen3-30B-A3B-Thinking-2507 | 70.1% | Independent | Epoch AI | 30 Aug 2026 |
| Qwen3-235B-A22B | 70.7% | Independent | Epoch AI | 3 Jun 2025 |
| Claude Haiku 4.5 Anthropic · 32K effort | 71.2% | Independent | Epoch AI | 22 Oct 2025 |
| DeepSeek-V3.2 | 71.2% | Independent | Epoch AI | 16 Jul 2026 |
| GLM-5.2 Z.ai (Zhipu AI) · None effort | 71.2% | Independent | Epoch AI | 10 Aug 2026 |
| Seed-OSS-36B-Instruct | 71.5% | Independent | Epoch AI | 30 Aug 2026 |
| GPT-5 mini OpenAI · Medium effort | 71.7% | Independent | Epoch AI | 7 Aug 2025 |
| DeepSeek-R1 | 71.7% | Independent | Epoch AI | 26 May 2025 |
| GPT-5 OpenAI · Minimal effort | 71.7% | Independent | Epoch AI | 20 Jul 2026 |
| GPT-5 mini OpenAI · Minimal effort | 71.7% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.4 nano OpenAI · Low effort | 72.2% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3-Max | 72.6% | Independent | Epoch AI | 6 Oct 2025 |
| Claude Opus 4.1 | 73.2% | Independent | Epoch AI | 5 Aug 2025 |
| DeepSeek-V4-Pro DeepSeek · None effort | 73.2% | Independent | Epoch AI | 6 Aug 2026 |
| Gemma 4 26B A4B Google DeepMind · Minimal effort | 73.2% | Independent | Epoch AI | 6 Aug 2026 |
| GPT-5.2 OpenAI · None effort | 73.2% | Independent | Epoch AI | 13 Jul 2026 |
| Claude Sonnet 4.5 | 73.7% | Independent | Epoch AI | 29 Sep 2025 |
| Gemini 3.1 Flash-Lite Google DeepMind · Minimal effort | 73.7% | Independent | Epoch AI | 6 Aug 2026 |
| Gemini 3.1 Flash-Lite Google DeepMind · Low effort | 74.2% | Independent | Epoch AI | 6 Aug 2026 |
| Gemini 3.5 Flash-Lite Google DeepMind · Minimal effort | 74.2% | Independent | Epoch AI | 6 Aug 2026 |
| o1 OpenAI · Low effort | 74.2% | Independent | Epoch AI | 20 Jul 2026 |
| o3-mini OpenAI · Medium effort | 74.3% | Independent | Epoch AI | 31 Jan 2025 |
| GPT-5.4 OpenAI · None effort | 74.7% | Independent | Epoch AI | 15 Jul 2026 |
| GPT-5 mini OpenAI · High effort | 75.0% | Independent | Epoch AI | 30 Oct 2025 |
| o4-mini OpenAI · Low effort | 75.3% | Independent | Epoch AI | 11 Jul 2026 |
| Grok 3 Mini SpaceXAI (xAI) · High effort | 75.5% | Independent | Epoch AI | 26 May 2025 |
| Claude Sonnet 4 Anthropic · 16K effort | 75.8% | Independent | Epoch AI | 22 May 2025 |
| Gemini 3.5 Flash-Lite Google DeepMind · Low effort | 75.8% | Independent | Epoch AI | 6 Aug 2026 |
| Gemma 4 31B Google DeepMind · Minimal effort | 75.8% | Independent | Epoch AI | 6 Aug 2026 |
| gpt-oss-120b OpenAI · High effort | 75.8% | Independent | Epoch AI | 11 Dec 2025 |
| Grok 3 | 75.8% | Independent | Epoch AI | 26 May 2025 |
| o1 OpenAI · Medium effort | 75.8% | Independent | Epoch AI | 27 Jan 2025 |
| Claude Opus 4 Anthropic · 16K effort | 76.3% | Independent | Epoch AI | 22 May 2025 |
| Grok 3 Mini SpaceXAI (xAI) · Low effort | 76.3% | Independent | Epoch AI | 10 Apr 2025 |
| DeepSeek-R1 | 76.3% | Independent | Epoch AI | 29 May 2025 |
| Claude 3.7 Sonnet Anthropic · 32K effort | 76.8% | Independent | Epoch AI | 10 Mar 2025 |
| Claude 3.7 Sonnet Anthropic · 16K effort | 76.8% | Independent | Epoch AI | 26 Feb 2025 |
| Claude Opus 4.1 Anthropic · 27K effort | 76.8% | Independent | Epoch AI | 5 Aug 2025 |
| o1 OpenAI · High effort | 76.8% | Independent | Epoch AI | 13 Feb 2025 |
| o3-mini OpenAI · High effort | 77.0% | Independent | Epoch AI | 13 Feb 2025 |
| Claude Opus 4.1 Anthropic · 16K effort | 77.3% | Independent | Epoch AI | 5 Aug 2025 |
| GPT-5.5 OpenAI · None effort | 77.3% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.6 Terra OpenAI · None effort | 77.3% | Independent | Epoch AI | 7 Aug 2026 |
| o4-mini OpenAI · Medium effort | 77.8% | Independent | Epoch AI | 7 Aug 2026 |
| Claude Sonnet 4 Anthropic · 32K effort | 78.3% | Independent | Epoch AI | 22 May 2025 |
| GPT-5.4 nano OpenAI · High effort | 78.5% | Independent | Epoch AI | 14 Apr 2026 |
| Claude Fable 5 Anthropic · Low effort | 78.8% | Independent | Epoch AI | 6 Aug 2026 |
| Claude Sonnet 4.5 Anthropic · 16K effort | 78.8% | Independent | Epoch AI | 28 Oct 2025 |
| Claude Sonnet 4.6 Anthropic · Max effort | 78.8% | Independent | Epoch AI | 6 Aug 2026 |
| Qwen3.5-9B Alibaba Group · None effort | 78.9% | Independent | Epoch AI | 27 Aug 2026 |
| Qwen3.5-9B | 79.0% | Independent | Epoch AI | 27 Aug 2026 |
| Claude Sonnet 4 Anthropic · 59K effort | 79.2% | Independent | Epoch AI | 26 May 2025 |
| o4-mini OpenAI · High effort | 79.6% | Independent | Epoch AI | 16 Apr 2025 |
| Claude 3.7 Sonnet Anthropic · 64K effort | 79.7% | Independent | Epoch AI | 26 May 2025 |
| o3 OpenAI · Low effort | 79.8% | Independent | Epoch AI | 15 Jul 2026 |
| Qwen3-235B-A22B-Thinking-2507 | 80.1% | Independent | Epoch AI | 11 Dec 2025 |
| Claude Sonnet 5 Anthropic · Max effort | 80.3% | Independent | Epoch AI | 6 Aug 2026 |
| Claude Opus 4.5 | 80.7% | Independent | Epoch AI | 24 Nov 2025 |
| o3 OpenAI · Medium effort | 80.8% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.7-Flash Alibaba Group · None effort | 80.8% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.5-35B-A3B Alibaba Group · None effort | 81.2% | Independent | Epoch AI | 28 Aug 2026 |
| MiniMax-M3 MiniMax · None effort | 81.3% | Independent | Epoch AI | 10 Aug 2026 |
| Claude Sonnet 4.5 Anthropic · 32K effort | 81.7% | Independent | Epoch AI | 21 Oct 2025 |
| Gemini 3.1 Flash-Lite Google DeepMind · High effort | 81.8% | Independent | Epoch AI | 6 Aug 2026 |
| o3 OpenAI · High effort | 81.8% | Independent | Epoch AI | 16 Apr 2025 |
| Qwen3.7-Plus Alibaba Group · None effort | 81.8% | Independent | Epoch AI | 7 Aug 2026 |
| Claude Sonnet 4.5 Anthropic · 59K effort | 82.3% | Independent | Epoch AI | 28 Oct 2025 |
| GPT-5.6 Luna OpenAI · Low effort | 82.3% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.5-Flash | 82.3% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.7-Flash | 82.3% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.2 OpenAI · Low effort | 82.7% | Independent | Epoch AI | 11 Dec 2025 |
| GPT-5.6 Sol OpenAI · None effort | 82.8% | Independent | Epoch AI | 7 Aug 2026 |
| Gemini 3 Flash | 83.2% | Independent | Epoch AI | 17 Dec 2025 |
| Claude Fable 5 Anthropic · High effort | 83.3% | Independent | Epoch AI | 6 Aug 2026 |
| Claude Sonnet 4.6 Anthropic · High effort | 83.3% | Independent | Epoch AI | 13 Jul 2026 |
| Claude Sonnet 4.6 Anthropic · Medium effort | 83.3% | Independent | Epoch AI | 13 Jul 2026 |
| Gemini 3.5 Flash-Lite Google DeepMind · High effort | 83.3% | Independent | Epoch AI | 6 Aug 2026 |
| GLM-4.7 | 83.3% | Independent | Epoch AI | 29 Jan 2026 |
| Qwen3.6-Flash | 83.3% | Independent | Epoch AI | 7 Aug 2026 |
| DeepSeek-V3.2 | 83.4% | Independent | Epoch AI | 16 Dec 2025 |
| Qwen3.5-35B-A3B | 83.5% | Independent | Epoch AI | 28 Aug 2026 |
| GPT-5.4 mini OpenAI · High effort | 83.6% | Independent | Epoch AI | 15 Apr 2026 |
| Gemini 2.5 Pro | 83.8% | Independent | Epoch AI | 31 Mar 2025 |
| Qwen3.6-35B-A3B | 83.8% | Independent | Epoch AI | 7 Aug 2026 |
| Kimi K2 Thinking | 84.2% | Independent | Epoch AI | 11 Nov 2025 |
| Gemini 2.5 Pro | 84.8% | Independent | Epoch AI | 5 Jun 2025 |
| GPT-5.4 OpenAI · Low effort | 84.8% | Independent | Epoch AI | 15 Jul 2026 |
| Kimi K3 Moonshot AI · Low effort | 84.8% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.5-Plus | 84.8% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.6-27B Alibaba Group · None effort | 84.8% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.6-35B-A3B Alibaba Group · None effort | 84.8% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.1 OpenAI · Medium effort | 85.0% | Independent | Epoch AI | 17 Nov 2025 |
| Gemini 2.5 Pro | 85.3% | Independent | Epoch AI | 16 Nov 2025 |
| Claude Opus 4.8 Anthropic · None effort | 85.4% | Independent | Epoch AI | 6 Aug 2026 |
| GPT-5 OpenAI · Medium effort | 85.4% | Independent | Epoch AI | 7 Aug 2025 |
| Claude Opus 4.5 Anthropic · 16K effort | 85.5% | Independent | Epoch AI | 25 Nov 2025 |
| Claude Fable 5 Anthropic · Max effort | 85.9% | Independent | Epoch AI | 6 Aug 2026 |
| Gemini 3.6 Flash Google DeepMind · Minimal effort | 85.9% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.5-397B-A17B | 85.9% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.6-27B | 85.9% | Independent | Epoch AI | 7 Aug 2026 |
| Claude Opus 4.5 Anthropic · 32K effort | 86.0% | Independent | Epoch AI | 24 Nov 2025 |
| GPT-5 OpenAI · High effort | 86.2% | Independent | Epoch AI | 29 Oct 2025 |
| Claude Opus 4.7 Anthropic · Max effort | 86.4% | Independent | Epoch AI | 6 Aug 2026 |
| Gemini 3.5 Flash Google DeepMind · Minimal effort | 86.4% | Independent | Epoch AI | 15 Jul 2026 |
| Gemini 3.6 Flash Google DeepMind · Low effort | 86.4% | Independent | Epoch AI | 6 Aug 2026 |
| Qwen3.5-397B-A17B Alibaba Group · None effort | 86.4% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.4 mini OpenAI · Xhigh effort | 86.9% | Independent | Epoch AI | 7 Aug 2026 |
| Grok 4 | 87.0% | Independent | Epoch AI | — |
| Claude Sonnet 4.6 Anthropic · 32K effort | 87.4% | Independent | Epoch AI | 20 Feb 2026 |
| GPT-5.6 Terra OpenAI · Low effort | 87.4% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.6-Max-Preview | 87.4% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.1 OpenAI · High effort | 87.6% | Independent | Epoch AI | 13 Nov 2025 |
| GLM-5 | 87.8% | Independent | Epoch AI | 12 Feb 2026 |
| Claude Opus 5 Anthropic · Low effort | 87.9% | Independent | Epoch AI | 6 Aug 2026 |
| GLM-5.2 Z.ai (Zhipu AI) · Low effort | 87.9% | Independent | Epoch AI | 10 Aug 2026 |
| GPT-5.2 OpenAI · Medium effort | 87.9% | Independent | Epoch AI | 11 Dec 2025 |
| Kimi K2.7 Code | 87.9% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.7-Plus | 87.9% | Independent | Epoch AI | 7 Aug 2026 |
| GPT-5.2 OpenAI · High effort | 88.2% | Independent | Epoch AI | 11 Dec 2025 |
| Inkling Thinking Machines Lab · Xhigh effort | 88.3% | Independent | Epoch AI | 5 Aug 2026 |
| Claude Opus 4.6 Anthropic · Max effort | 88.4% | Independent | Epoch AI | 6 Aug 2026 |
| Claude Opus 4.8 Anthropic · Low effort | 88.4% | Independent | Epoch AI | 6 Aug 2026 |
| Qwen3.6-Plus | 88.4% | Independent | Epoch AI | 7 Aug 2026 |
| Inkling Small Thinking Machines Lab · Xhigh effort | 88.5% | Independent | Epoch AI | 14 Aug 2026 |
| Claude Opus 4.6 Anthropic · 64K effort | 88.8% | Independent | Epoch AI | 6 Feb 2026 |
| Grok 4.3 SpaceXAI (xAI) · High effort | 88.8% | Independent | Epoch AI | 17 Jun 2026 |
| Gemini 3.5 Flash Google DeepMind · Low effort | 88.9% | Independent | Epoch AI | 6 Aug 2026 |
| GPT-5.4 OpenAI · Medium effort | 88.9% | Independent | Epoch AI | 15 Jul 2026 |
| Grok 4.20 | 89.3% | Independent | Epoch AI | 13 Jul 2026 |
| Gemini 3 Flash Google DeepMind · High effort | 89.4% | Independent | Epoch AI | 6 Aug 2026 |
| DeepSeek-V4-Pro DeepSeek · Max effort | 89.6% | Independent | Epoch AI | 16 Jun 2026 |
| GLM-5.1 | 89.9% | Independent | Epoch AI | 10 Aug 2026 |
| GPT-5.4 OpenAI · High effort | 89.9% | Independent | Epoch AI | 15 Jul 2026 |
| GPT-5.6 Sol OpenAI · Low effort | 89.9% | Independent | Epoch AI | 7 Aug 2026 |
| Claude Opus 4.7 Anthropic · Xhigh effort | 90.2% | Independent | Epoch AI | 17 Apr 2026 |
| GLM-5.3-Flash Z.ai (Zhipu AI) · Max effort | 90.2% | Independent | Epoch AI | 26 Aug 2026 |
| Claude Opus 4.6 Anthropic · 32K effort | 90.5% | Independent | Epoch AI | 6 Feb 2026 |
| Claude Sonnet 5 Anthropic · Xhigh effort | 90.5% | Independent | Epoch AI | 1 Jul 2026 |
| Claude Opus 5.5 Anthropic · Max effort | 90.6% | Independent | Epoch AI | 22 Sep 2026 |
| GPT-5.5 OpenAI · Low effort | 90.7% | Independent | Epoch AI | 5 May 2026 |
| Kimi K2.6 | 90.8% | Independent | Epoch AI | 1 May 2026 |
| DeepSeek-V4-Pro DeepSeek · High effort | 90.9% | Independent | Epoch AI | 6 Aug 2026 |
| GLM-5.3 Z.ai (Zhipu AI) · Max effort | 90.9% | Independent | Epoch AI | 24 Aug 2026 |
| MiniMax-M3 | 90.9% | Independent | Epoch AI | 10 Aug 2026 |
| Qwen3.7-Max | 90.9% | Independent | Epoch AI | 7 Aug 2026 |
| Claude Opus 4.8 Anthropic · Max effort | 91.0% | Independent | Epoch AI | 7 Jun 2026 |
| DeepSeek-V4-Flash DeepSeek · Max effort | 91.0% | Independent | Epoch AI | 2 Aug 2026 |
| GPT-5.2 OpenAI · Xhigh effort | 91.4% | Independent | Epoch AI | 13 Dec 2025 |
| GPT-5.6 Luna OpenAI · Max effort | 91.6% | Independent | Epoch AI | 9 Jul 2026 |
| DeepSeek-V4-Pro DeepSeek · Max effort | 91.7% | Independent | Epoch AI | 18 Aug 2026 |
| GLM-5.2 Z.ai (Zhipu AI) · Max effort | 91.9% | Independent | Epoch AI | 24 Jun 2026 |
| Kimi K3 Moonshot AI · High effort | 91.9% | Independent | Epoch AI | 7 Aug 2026 |
| Qwen3.8-Max Alibaba Group · Xhigh effort | 92.3% | Independent | Epoch AI | 2 Sep 2026 |
| Gemini 3 Pro | 92.6% | Independent | Epoch AI | 19 Nov 2025 |
| Qwen3.8-Max Alibaba Group · Xhigh effort | 92.7% | Independent | Epoch AI | 4 Aug 2026 |
| Gemini 3.5 Flash Google DeepMind · High effort | 92.8% | Independent | Epoch AI | 22 May 2026 |
| Claude Opus 5 | 92.9% | Independent | Epoch AI | 6 Aug 2026 |
| Kimi K3 Moonshot AI · Max effort | 93.1% | Independent | Epoch AI | 16 Jul 2026 |
| Grok 4.6 SpaceXAI (xAI) · Xhigh effort | 93.2% | Independent | Epoch AI | 14 Aug 2026 |
| GPT-5.4 OpenAI · Xhigh effort | 93.3% | Independent | Epoch AI | 6 Mar 2026 |
| GPT-5.6 Terra OpenAI · Max effort | 93.3% | Independent | Epoch AI | 9 Jul 2026 |
| Grok 4.5 SpaceXAI (xAI) · High effort | 93.4% | Independent | Epoch AI | 8 Jul 2026 |
| GPT-5.6 Sol OpenAI · Max effort | 93.5% | Independent | Epoch AI | 9 Jul 2026 |
| Claude Opus 5 Anthropic · Max effort | 93.9% | Independent | Epoch AI | 24 Jul 2026 |
| Grok 4.6 SpaceXAI (xAI) · High effort | 94.0% | Independent | Epoch AI | 12 Aug 2026 |
| Gemini 3.1 Pro | 94.1% | Independent | Epoch AI | 20 Feb 2026 |
| Gemini 3.6 Flash Google DeepMind · High effort | 94.1% | Independent | Epoch AI | 2 Aug 2026 |
| Gemini 3.1 Pro Google DeepMind · High effort | 94.4% | Independent | Epoch AI | 6 Aug 2026 |
| GPT-5.4 Pro OpenAI · Xhigh effort | 94.6% | Independent | Epoch AI | 20 Mar 2026 |
| Gemini 3.7 Flash Google DeepMind · High effort | 94.8% | Independent | Epoch AI | 14 Aug 2026 |
| Gemini 3.8 Flash Google DeepMind · High effort | 95.4% | Independent | Epoch AI | 2 Sep 2026 |
| GPT-6 Astra OpenAI · Max effort | 95.8% | Independent | Epoch AI | 30 Aug 2026 |
- Epoch AI, 'Capabilities & benchmarking', epoch.ai/benchmarks, CC BY 4.0.