Ubuntu OSWorld Verified Trajectories: 100K+ Multimodal Agent Paths

OSWorld-Verified Model Trajectories contains between 100,000 and 1,000,000 evaluation records of multimodal AI agents performing tasks in real computer environments. Created by xlangai and updated in March 2026, the data captures verified execution paths and screenshots from state-of-the-art models tested on the OSWorld benchmark.

Use Cases

• Training multimodal agents to map visual screenshots to specific OS actions
• Benchmarking agent performance against verified trajectories from state-of-the-art models
• Analyzing failure modes in agent navigation within graphical user interfaces

Strengths

• Scale of 100,000 to 1,000,000 verified trajectories
• Includes multimodal evidence via screenshots of the OS state
• Released under the MIT license for permissive research use

Limitations

• Environment is restricted to the Ubuntu operating system
• Data is packaged in zip files which may require significant local storage and extraction time

Provenance

Source

xlangai

Collection Method

Model evaluation results generated within the OSWorld benchmark environment

Freshness

Last updated March 2026.