Legal RAG Bench: 4,876 Passages and 100 Expert Legal Questions

Legal RAG Bench provides 4,876 passages from the Judicial College of Victoria’s Criminal Charge Book paired with 100 expert-handwritten questions. Created by Isaacus and updated in March 2026, it benchmarks the reasoning capabilities of legal RAG systems within the context of Victorian criminal law.

Use Cases

• Evaluating retrieval performance using the 4,876 passages from the Criminal Charge Book
• Testing reasoning-intensive question answering against 100 expert-level legal queries
• Benchmarking production-grade legal RAG systems on Victorian criminal procedure

Strengths

• 4,876 passages from the Judicial College of Victoria
• 100 expert-generated handwritten questions
• Expert-level annotations for Victorian criminal law

Limitations

• Small evaluation set of 100 questions
• Geographic bias restricted to Victorian criminal law

Provenance

Source

Judicial College of Victoria’s Criminal Charge Book

Collection Method

Sampled passages and expert-handwritten questions

Freshness

Updated March 2026

Geography

Victoria, Australia