Synthux Economy R8 W109: Simulated Desktop Computer-Use Trajectories

Grounded visual computer-use trajectories generated by the SynthUX system. Each record captures one worker's device session inside a simulated company, where goals drive interactions with desktop-simulator apps like Terminal, VS Code, and Slack through low-level mouse and keyboard inputs. The dataset was created by jacob-valdez and was last updated on June 2, 2026.

Use Cases

• Train or evaluate AI agents for desktop task automation based on low-level mouse and keyboard input sequences.
• Study human-like computer interaction patterns based on goal-driven, node-tree structured tasks.
• Develop models for screen understanding and action prediction based on recorded screen video and per-node frames.

Strengths

• Data includes screen video recordings, providing a rich visual context for interactions.
• Trajectories are grounded in a simulated company environment with specific goals, suggesting structured task data.
• Interactions span multiple common desktop applications (e.g., VS Code, Browser, Slack), indicating diverse task coverage.

Limitations

• Description metadata is limited; actual data quality requires manual inspection after download.
• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.

Provenance

Source

jacob-valdez on Hugging Face

Collection Method

Generated by the SynthUX system using a simulated desktop environment.

Freshness

Last updated 2026-06-02 04:08:30; freshness should be verified.