SimpleQA

Measures: The model answers short fact-seeking questions written adversarially against GPT-4. Each answer is graded correct, incorrect or not attempted, and the results are reported as % correct and an F-score.

Maintainer: OpenAI (original); a Kaggle-hosted leaderboard is still updated
Introduced: 2024
Status: Superseded
Saturation: Headroom
Typical provenance: Mixed
In scoring set: No

Paper Official leaderboard

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.