Updated daily at 05:00 UTC
Benchmark
GDPval-AA
Measures: An agent with shell and web access (Artificial Analysis's Stirrup harness) produces real work deliverables for OpenAI's 220 public GDPval tasks across 44 occupations; each pair of model outputs is compared blind by a panel of three LLM judges and the results are fitted to an Elo scale.
- Maintainer
- Artificial Analysis (task set from OpenAI's GDPval)
- Introduced
- —
- Status
- Active
- Saturation
- Headroom
- Typical provenance
- Independent
- In scoring set
- Yes
Leaderboard
Independent and third-party results only.
No independent or third-party results yet. Show all results