GUI Grounding Training Data with Bounding Box Annotations

A 240 GB collection of full image files for GUI grounding training with bounding box supervision, released by Microsoft researchers in 2025. The dataset supports projects focused on user interface understanding and visual grounding tasks.

Use Cases

• Train computer vision models for GUI grounding using the provided bounding box supervision.
• Develop models to localize and understand user interface elements from the annotated image files.
• Benchmark object detection and grounding algorithms on user interface imagery.

Strengths

• Contains 240 GB of full image files for model training.
• Provides bounding box supervision for precise GUI element localization.
• Associated with a published research paper and project from Microsoft.

Limitations

• The total number of images, rows, and specific column structure are not specified.
• Dataset scope and specific annotation details are not fully described in the provided input.

Provenance

Source

Microsoft Research (GUI-Actor project).

Collection Method

Created for GUI grounding training, likely involving screenshot collection and bounding box annotation.

Freshness

Last updated on 2025-06-16.