ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Software

ScreenSpot-Pro contains between 1,000 and 10,000 high-resolution GUI screenshots for grounding tasks, published by likaixin in 2026. It targets professional software environments on macOS, specifically providing labeled coordinates for icons and text elements in tools like Visual Studio Code, PyCharm, and Android Studio.

Use Cases

• Training GUI agents to locate specific icons in Visual Studio Code
• Grounding natural language instructions to text elements in PyCharm
• Developing object detection models for Android Studio UI components

Strengths

• 1,000 to 10,000 high-resolution records
• Specific element counts for icons and text per application (e.g., 44 icons for Android Studio)
• Covers specialized professional IDEs like Visual Studio Code and PyCharm

Limitations

• Limited to macOS operating system interfaces
• Narrow software scope focused primarily on development and programming tools
• Large image sizes may cause memory issues during loading and processing

Provenance

Source

likaixin via Hugging Face

Collection Method

Annotated screenshots of professional software

Time Range

2023-2026

Freshness

Last updated February 2026.