Knowledge & reasoning

A model's score is built only from results that someone other than its maker ran.

• The scoring set is the benchmarks chosen for this specialty. A benchmark takes part only when at least 5 models have an independent or third-party result on it.
• Each result is rescaled to 0 to 1, and a model's best setting counts.
• The score is the average over the benchmarks a model has, times 100.
• A model ranks only when it has results on enough of them. The rest show "Not enough independent results yet".
• Self-reported results are shown but never counted.

Method: category-2026-09-29.1

Scoring set: ARC-AGI-3, Humanity's Last Exam (HLE), LiveBench, SimpleBench, Chess Puzzles, Earthborne Rangers (EBR-bench), LMCA (Language Model Conceptual Argumentation).

Effective set (used for the score today): SimpleBench, Chess Puzzles, Earthborne Rangers (EBR-bench), LMCA (Language Model Conceptual Argumentation)

• ARC-AGI-3: no importable independent results yet
• Humanity's Last Exam (HLE): no importable independent results yet
• LiveBench: no importable independent results yet

• AI2 Reasoning Challenge (ARC)UnmaintainedSaturated62 results
• ARC-AGI-1ActiveSaturated0 results
• ARC-AGI-2ActiveSaturated0 results
• ARC-AGI-3ActiveNear-ceilingCounts toward the score0 results
• Adversarial NLI (ANLI)UnmaintainedNear-ceiling9 results
• BIG-Bench Hard (BBH)UnmaintainedNear-ceiling44 results
• Chess PuzzlesActiveHeadroomCounts toward the score213 results
• DTBench (Decision Theory Benchmark)ActiveSaturated208 results
• Earthborne Rangers (EBR-bench)ActiveHeadroomCounts toward the score23 results
• EnigmaEvalActiveHeadroom0 results
• HLE-DiamondActiveHeadroom0 results
• HellaSwagUnmaintainedSaturated63 results
• Humanity's Last Exam (HLE)ActiveHeadroomCounts toward the score46 results
• LAMBADAUnmaintainedNear-ceiling20 results
• LMCA (Language Model Conceptual Argumentation)ActiveNear-ceilingCounts toward the score172 results
• LiveBenchActiveNear-ceilingCounts toward the score0 results
• MMLUUnmaintainedNear-ceiling133 results
• MMLU-ProUnmaintainedSaturated71 results
• Mystery Game PuzzlesActiveNear-ceiling128 results
• OpenBookQAUnmaintainedNear-ceiling34 results
• PIQAUnmaintainedNear-ceiling57 results
• ScienceQAUnmaintainedSaturated11 results
• SimpleBenchActiveNear-ceilingCounts toward the score100 results
• SuperGLUEUnmaintainedNear-ceiling1 result
• WinoGrandeUnmaintainedHeadroom66 results