Tau2 Bench Verified Airline: Multi-Turn Code Agent Interaction Traces

Fewer than 1,000 multi-turn interaction traces between code agents and AI assistants within a verified airline environment. Produced by Snorkel AI and updated in 2026, it utilizes the Sierra.ai Tau^2 Bench Airline environment as verified by the Amazon AGI group.

Use Cases

• Analyzing code agent reasoning by examining the multi-turn interaction traces
• Validating AI assistant responses against the metadata provided for the Airline environment
• Benchmarking agent performance by comparing code-based traces with the original bespoke tool task versions

Strengths

• Verified by Amazon AGI group
• Includes comparative bespoke tool versions
• Apache 2.0 license

Limitations

• Small sample size of fewer than 1,000 records
• Domain-specific bias toward airline customer service scenarios

Provenance

Source

Sierra.ai and Amazon AGI group

Collection Method

Simulated agent interactions

Freshness

Last updated March 2026