Global-MMLU-Lite

Measures: A human-translated MMLU subset with 200 culturally sensitive and 200 culturally agnostic questions per language (15 languages at launch, 23 in v3.0); multiple-choice accuracy averaged over languages.

Maintainer: Cohere Labs
Introduced: 2024
Status: Active
Saturation: Saturated
Typical provenance: Mixed
In scoring set: No

Paper

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.