AA-Briefcase

Measures: An agent (Stirrup harness) works through multi-week business projects, each with many linked tasks and thousands of source files (emails, chat threads, spreadsheets), and produces deliverables such as spreadsheets, presentations and memos; 91 tasks in 4 held-out scenarios are graded by binary rubric checks plus pairwise judging of analytical and presentation quality, combined into one Elo.

Maintainer: Artificial Analysis
Introduced: 2026
Status: Active
Saturation: Headroom
Typical provenance: Independent
In scoring set: Yes

Official leaderboard

Leaderboard

Show independent results only

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

No results to show.