WebBench: 2,454 Real-World Browser Agent Tasks Across 452 Live Websites

2,454 tasks across 452 live websites selected from the global top-1000 by traffic measure how well browser agents handle realistic web workflows. The benchmark is open and task-oriented, focusing on information extraction and navigation. It was created by Halluminate and last updated in May 2025.

Use Cases

• Benchmarking agent performance on information extraction tasks based on the READ category.
• Training browser agents to navigate complex, live websites based on the realistic web workflows described.
• Evaluating the robustness of web automation tools across a diverse set of high-traffic sites.

Strengths

• Contains 2,454 tasks providing a substantial testbed for evaluation.
• Based on 452 live websites from the global top-1000, offering real-world relevance.

Limitations

• Column-level documentation is absent; field semantics must be inferred after download.
• Row count and specific file formats are unknown, which may limit suitability assessment.

Provenance

Source

Halluminate

Collection Method

Likely curated from live websites; specific gathering method is not detailed.

Freshness

Last updated 2025-06-24 02:48:48.