Benchmark

LLM Creative Story-Writing Benchmark (Lech Mazur)

Measures: The model writes 600-800-word stories that must work in 10 required elements (character, object, concept, setting, tone and so on). A panel of LLM evaluators judges matched story pairs in both orders. A Thurstone model with a presentation-order correction turns the judgments into a relative comparison score.

Maintainer
Lech Mazur
Introduced
2025
Status
Active
Saturation
Headroom
Typical provenance
Independent
In scoring set
Yes

Official leaderboard

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.

LLM Creative Story-Writing Benchmark (Lech Mazur): leaderboard and what it measures · supermarket.dev