LongBench v2

Measures: 503 multiple-choice questions over contexts of 8K to 2M words in six task types (single- and multi-document QA, long in-context learning, long dialogue history, code repositories, long structured data); scored by accuracy.

Maintainer: THUDM, Tsinghua University (Yushi Bai et al.)
Introduced: 2024
Status: Active
Saturation: Headroom
Typical provenance: Self-reported
In scoring set: No

Paper Official leaderboard

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.