Updated daily at 05:00 UTC
Benchmark
OSWorld-Verified
Measures: A multimodal agent completes 369 open-ended tasks on real Ubuntu/Windows desktops (office apps, browser, file system, multi-app workflows), checked by execution-based evaluation scripts; scored as % of tasks completed within a step budget (15/50/100 steps).
- Maintainer
- XLANG Lab, University of Hong Kong
- Introduced
- 2024
- Status
- Superseded
- Saturation
- Saturated
- Typical provenance
- Mixed
- In scoring set
- No
Leaderboard
Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.
- Epoch AI, 'Capabilities & benchmarking', epoch.ai/benchmarks, CC BY 4.0.