Video-MMMU

Measures: 300 expert-level lecture videos in six disciplines with 900 questions at three stages (perception, comprehension, adaptation); scored by accuracy, plus a knowledge-gain score (improvement after watching the video).

Maintainer: S-Lab, Nanyang Technological University (Kairui Hu et al.)
Introduced: 2025
Status: Active
Saturation: Near-ceiling
Typical provenance: Self-reported
In scoring set: No

Paper Official leaderboard

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.