Synthux Economy R9 W220: Simulated Desktop Computer-Use Trajectories

SynthUX Computer-Use Dataset contains visual trajectories of device sessions within a simulated company environment. Each record captures one worker's session, where a goal expands into a node tree, terminal nodes drive desktop-simulator applications, and the observed trajectory is recorded as screen video with per-node frames. The dataset was created by jacob-valdez and was last updated on June 4, 2026.

Use Cases

• Train AI agents for desktop task automation based on simulated low-level mouse and keyboard input.
• Analyze user workflow patterns based on the node tree structure of expanded goals.
• Develop computer vision models for screen understanding based on the recorded screen video and per-node frames.
• Benchmark multimodal models using the combination of video, application state, and input events.

Strengths

• Trajectories are grounded in a simulated company environment with specific goals.
• Data captures interactions with a range of common desktop applications like Terminal, VS Code, Browser, and Slack/Teams.
• Each record includes multiple modalities: screen video and per-node frames.

Limitations

• Description metadata is limited; actual data quality requires manual inspection after download.
• Row count is unknown, which may limit suitability assessment.
• Column-level documentation is absent; field semantics must be inferred after download.

Provenance

Source

jacob-valdez via Hugging Face

Collection Method

Generated by the SynthUX system simulating worker device sessions.

Freshness

Last updated 2026-06-04 07:06:01; freshness should be verified.