Two-Box Judge GUI: A Multimodal Dataset for GUI Element Selection Models

Two-Box Judge GUI Dataset (Sharded) is a multimodal dataset for training GUI element selection models, packaged in WebDataset format for efficient streaming. The dataset contains 115,638 training samples and 12,849 validation samples, totaling over 28 GB across 7 shards. It was created by author Micasa997 and last updated on February 4, 2026.

Use Cases

• Train GUI element detection models based on multimodal data mentioned in the description
• Benchmark model performance on GUI interaction tasks using the provided train/validation splits
• Develop automated software testing tools based on GUI element selection capabilities
• Research human-computer interaction patterns from GUI screenshots and annotations

Strengths

• Dataset is structured for efficient streaming with WebDataset format across 7 shards
• Contains a substantial training set of 115,638 samples
• Includes a dedicated validation split of 12,849 samples for model evaluation

Limitations

• Column-level documentation is absent; field semantics must be inferred after download
• Description metadata is limited; actual data quality requires manual inspection after download
• Row count is unknown, which may limit suitability assessment

Provenance

Source

Micasa997

Freshness

Last updated 2026-02-04 13:49:20; freshness should be verified