Benchmark

PRBench Legal (Professional Reasoning Benchmark)

Measures: Models answer 500 real legal questions written by JD-holding experts (about 30% multi-turn, 114 countries, 47 US jurisdictions); each response is scored by an LLM judge (o4-mini) against a 10-30 item weighted expert rubric, clipped to 0-1.

Maintainer
Scale AI
Introduced
2025
Status
Active
Saturation
Headroom
Typical provenance
Mixed
In scoring set
Yes

PaperOfficial leaderboard

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.

PRBench Legal (Professional Reasoning Benchmark): leaderboard and what it measures · supermarket.dev