MMMU-Pro

Measures: College-level multimodal multiple-choice questions (up to 10 options), filtered so text-only models cannot answer them, plus a vision-only setting where the whole question sits inside a screenshot or photo; scored by accuracy.

Maintainer: MMMU team (Xiang Yue et al.)
Introduced: 2024
Status: Active
Saturation: Near-ceiling
Typical provenance: Mixed
In scoring set: Yes

Paper Official leaderboard

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.