Updated daily at 05:00 UTC
Benchmark
LiveBench
Measures: Contamination-limited suite of 23 objective, auto-graded tasks in 7 categories (reasoning, coding, agentic coding, math, data analysis, language, instruction following), refreshed with new questions; overall = mean of category averages.
- Maintainer
- LiveBench team (Abacus.AI, NYU, Nvidia, UMD, USC); sponsored by Abacus.AI
- Introduced
- 2024
- Status
- Active
- Saturation
- Near-ceiling
- Typical provenance
- Independent
- In scoring set
- Yes
Leaderboard
Independent and third-party results only.
No independent or third-party results yet. Show all results