Benchmark

MMLU-ProX

Measures: MMLU-Pro's 10-option reasoning questions translated into 29 typologically diverse languages (11,829 parallel questions per language; 658-question Lite set); accuracy averaged over languages.

Maintainer
University of Tokyo and collaborators (Xuan et al.)
Introduced
2025
Status
Active
Saturation
Near-ceiling
Typical provenance
Self-reported
In scoring set
No

Paper

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.

MMLU-ProX: leaderboard and what it measures · supermarket.dev