OSWorld

OSWorld tests agents on completing tasks in real computer environments, such as editing a spreadsheet or changing a setting, by looking at the screen and using mouse and keyboard.

Humans complete most of these tasks easily, while models have found it much harder.