Benchmark

HealthBench (incl. Hard and Consensus)

Measures: Models respond to 5,000 multi-turn health conversations with users or clinicians, graded against 48,562 conversation-specific rubric criteria written by 262 physicians; the Hard and Consensus subsets are reported separately.

Maintainer
OpenAI
Introduced
2025
Status
Active
Saturation
Headroom
Typical provenance
Self-reported
In scoring set
No

Paper

Leaderboard

Independent and third-party results only.

No independent or third-party results yet. Show all results

HealthBench (incl. Hard and Consensus): leaderboard and what it measures · supermarket.dev