Benchmarks

Professional knowledge work

Producing real deliverables (documents, spreadsheets, analyses) of the kind professionals are paid for, judged against expert work.

See the ranking

How the score works

A model's score is built only from results that someone other than its maker ran.

  • The scoring set is the benchmarks chosen for this specialty. A benchmark takes part only when at least 5 models have an independent or third-party result on it.
  • Each result is rescaled to 0 to 1, and a model's best setting counts.
  • The score is the average over the benchmarks a model has, times 100.
  • A model ranks only when it has results on enough of them. The rest show "Not enough independent results yet".
  • Self-reported results are shown but never counted.

Method: category-2026-09-29.1

Scoring set and effective set

Scoring set: AA-Briefcase, APEX-Agents, GDPval-AA, Remote Labor Index (RLI), TheAgentCompany.

Effective set (used for the score today): TheAgentCompany

All benchmarks

AI benchmarks for Professional knowledge work · supermarket.dev