Benchmark

PRBench Legal (Professional Reasoning Benchmark)

Measures: Models answer 500 real legal questions written by JD-holding experts (about 30% multi-turn, 114 countries, 47 US jurisdictions); each response is scored by an LLM judge (o4-mini) against a 10-30 item weighted expert rubric, clipped to 0-1.

Maintainer
Scale AI
Introduced
2025
Status
Active
Saturation
Headroom
Typical provenance
Mixed
In scoring set
Yes

PaperOfficial leaderboard

Leaderboard

Independent and third-party results only.

No independent or third-party results yet. Show all results