RouterArena: 8,400 Questions from 9 Domains for LLM Routing Tests

8,400 questions curated from the RouterEvalBenchmark for testing LLM routers. The dataset is organized into 9 subject domains and 44 Dewey Decimal categories. It was created by RouteWorks and last updated on December 3, 2025.

Use Cases

• Benchmarking LLM routing algorithms based on question domain classification
• Evaluating model specialization performance across categories like Computer Science and History
• Training router models to categorize queries using the Bloom Taxonomy framework
• Testing the robustness of multi-domain question answering systems

Strengths

• 8,400 questions provide a substantial test corpus
• Questions are organized into 9 distinct subject domains for structured evaluation
• Categories are defined by the Dewey Decimal Classification system

Limitations

• Column-level documentation is absent; field semantics must be inferred after download
• Row count is known, but other scale details like file formats and size are unknown

Provenance

Source

RouteWorks

Collection Method

Curated from the RouterEvalBenchmark

Freshness

Last updated 2025-12-03 21:03:18