Updated daily at 05:00 UTC
Benchmarks
Factuality & hallucination
Answering factual questions correctly, abstaining when unsure, and staying grounded in provided sources.
How the score works
A model's score is built only from results that someone other than its maker ran.
- The scoring set is the benchmarks chosen for this specialty. A benchmark takes part only when at least 5 models have an independent or third-party result on it.
- Each result is rescaled to 0 to 1, and a model's best setting counts.
- The score is the average over the benchmarks a model has, times 100.
- A model ranks only when it has results on enough of them. The rest show "Not enough independent results yet".
- Self-reported results are shown but never counted.
Method: category-2026-09-29.1
Scoring set and effective set
Scoring set: AA-Omniscience, FACTS Benchmark Suite, SimpleQA Verified, Vectara Hallucination Leaderboard (HHEM).
Effective set (used for the score today): SimpleQA Verified
- AA-Omniscience: no importable independent results yet
- FACTS Benchmark Suite: no importable independent results yet
- Vectara Hallucination Leaderboard (HHEM): no importable independent results yet
All benchmarks
- AA-OmniscienceActiveHeadroomCounts toward the score0 results
- FACTS Benchmark SuiteActiveHeadroomCounts toward the score0 results
- FACTS GroundingActiveHeadroom0 results
- SimpleQASupersededHeadroom0 results
- SimpleQA VerifiedActiveHeadroomCounts toward the score81 results
- TriviaQAUnmaintainedNear-ceiling53 results
- Vectara Hallucination Leaderboard (HHEM)ActiveNear-ceilingCounts toward the score0 results