GroundCUA: UI Screenshots and Annotations for Computer Use Agents

GroundCUA is a large dataset of real UI screenshots paired with structured annotations for building multimodal computer use agents. It covers 87 software platforms across productivity tools, browsers, creative tools, communication apps, development environments, and system utilities. The dataset was created by Fhrozen and last updated on Hugging Face in November 2025.

Use Cases

• Train multimodal models for UI understanding based on annotated screenshots.
• Benchmark computer use agents across diverse software platforms.
• Develop agents for task automation in productivity and creative tools.

Strengths

• Covers 87 distinct software platforms.
• Pairs UI screenshots with structured annotations.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count is unknown, which may limit suitability assessment.

Provenance

Source

Hugging Face user Fhrozen.

Collection Method

Likely collected from human demonstrations of computer use.

Freshness

Last updated 2025-11-14 08:00:44