Benchmark

MMMLU (Multilingual MMLU)

Measures: The MMLU test set (57 subjects) professionally human-translated into 14 languages; multiple-choice accuracy averaged across languages.

Maintainer
OpenAI
Introduced
2024
Status
Active
Saturation
Saturated
Typical provenance
Self-reported
In scoring set
No

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.

MMMLU (Multilingual MMLU): leaderboard and what it measures · supermarket.dev