Synthux Economy R9 W216: Simulated Desktop Computer-Use Trajectories

Grounded visual computer-use trajectories generated by the SynthUX system. Each record captures one worker's device session inside a simulated company, where goals drive interactions with applications like Terminal, VS Code, and Slack through low-level mouse and keyboard inputs. The dataset was authored by jacob-valdez and last updated on 2026-06-04.

Use Cases

• Train or benchmark AI agents for desktop automation based on the low-level mouse and keyboard input sequences.
• Study human-computer interaction patterns based on the recorded screen videos and per-node frames.
• Develop models for task decomposition based on the goal-to-node-tree structure described.
• Simulate and analyze workplace software usage based on the included applications like VS Code, Browser, and Sheets.

Strengths

• Includes screen video recordings of user interactions.
• Captures low-level input events (mouse/keyboard) for detailed action analysis.
• Simulates interactions with a variety of common desktop applications (Terminal, VS Code, Slack, etc.).

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.
• Data is synthetic, generated in a simulated environment, which may not fully reflect real-world user behavior.

Provenance

Source

huggingface

Collection Method

Generated by the SynthUX system within a simulated company environment.

Freshness

Last updated 2026-06-04 06:22:31.