Benchmark

MMLU-Pro

Measures: Harder, reasoning-focused MMLU successor: multiple-choice questions across many academic subjects, with 10 answer options instead of 4; scored as accuracy.

Maintainer
TIGER-Lab
Introduced
2024
Status
Unmaintained
Saturation
Saturated
Typical provenance
Mixed
In scoring set
No

PaperOfficial leaderboard

Leaderboard

Independent and third-party results only.

No independent or third-party results yet. Show all results