LiveBench

Measures: Contamination-limited suite of 23 objective, auto-graded tasks in 7 categories (reasoning, coding, agentic coding, math, data analysis, language, instruction following), refreshed with new questions; overall = mean of category averages.

Maintainer: LiveBench team (Abacus.AI, NYU, Nvidia, UMD, USC); sponsored by Abacus.AI
Introduced: 2024
Status: Active
Saturation: Near-ceiling
Typical provenance: Independent
In scoring set: Yes

Paper Official leaderboard

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.