Synthux Economy R8 W177: Simulated Desktop Computer-Use Trajectories

Grounded visual computer-use trajectories generated by SynthUX. Each record captures one worker's device session inside a simulated company, where goals drive interactions with desktop-simulator applications. The dataset was created by author jacob-valdez and was last updated on June 2, 2026.

Use Cases

• Training or evaluating AI agents for desktop task automation based on the described low-level mouse/keyboard input sequences.
• Analyzing human-computer interaction patterns from the recorded screen videos and per-node frames.
• Developing models for goal decomposition and task planning based on the described node-tree structure of user sessions.
• Studying cross-application workflow patterns using the mentioned simulator apps (Terminal, VS Code, Browser, Slack/Teams, etc.).

Strengths

• Data includes screen video recordings, providing a rich visual context for user actions.
• Trajectories are grounded in a simulated company environment with specific user goals, adding semantic structure.
• Interactions span multiple common desktop applications, as mentioned in the description.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Description metadata is limited; actual data quality requires manual inspection after download.

Provenance

Source

huggingface

Collection Method

Generated by the SynthUX system within a simulated company environment.

Freshness

Last updated 2026-06-02 13:05:14; freshness should be verified.