Updated daily at 05:00 UTC

Benchmark

MMMLU (Multilingual MMLU)

Measures: The MMLU test set (57 subjects) professionally human-translated into 14 languages; multiple-choice accuracy averaged across languages.

Maintainer: OpenAI
Introduced: 2024
Status: Active
Saturation: Saturated
Typical provenance: Self-reported
In scoring set: No

Leaderboard

Show all results

Independent and third-party results only.

No independent or third-party results yet. Show all results