Synthux Economy R8 W155: Simulated Desktop Computer-Use Trajectories

SynthUX Computer-Use Dataset contains grounded visual computer-use trajectories generated by the SynthUX system. Each record captures one worker's device session inside a simulated company, with goals driving actions through desktop-simulator apps like Terminal, VS Code, and Slack. The dataset was authored by jacob-valdez and last updated on June 2, 2026.

Use Cases

• Training or evaluating AI agents for desktop task automation based on the described low-level mouse/keyboard input sequences.
• Researching human-computer interaction patterns based on the described goal-driven node trees and app interactions.
• Developing models for screen understanding and activity recognition based on the recorded screen videos and per-node frames.
• Generating synthetic training data for multimodal models based on the described combination of video and structured interaction data.

Strengths

• Data is generated by the SynthUX system, which provides a structured, simulated environment for computer-use tasks.
• Trajectories include multimodal data: screen video plus per-node frames, as described.
• Dataset page indicates a specific version and release (economy sim r8, w155).

Limitations

• Description metadata is limited; actual data quality requires manual inspection after download.
• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.

Provenance

Source

huggingface

Collection Method

Generated by the SynthUX system simulating worker sessions in a simulated company environment.

Freshness

Last updated 2026-06-02 10:15:32; freshness should be verified.