Benchmark

AndroidWorld

Measures: An agent operates a live Android emulator across 20 apps to complete 116 parameterised tasks (randomised each run), checked from device state; scored as % of tasks completed.

Maintainer
Google Research / Google DeepMind
Introduced
2024
Status
Active
Saturation
Saturated
Typical provenance
Mixed
In scoring set
No

PaperOfficial leaderboard

Leaderboard

Independent and third-party results only.

No independent or third-party results yet. Show all results