τ²-Bench Airline Domain

τ²-bench Airline tests conversational agents on airline customer-service tasks governed by domain policy and database-changing tools.

4 models

Higher is better.

Higher is better. Bar colour: blue proprietary, orange open weights, green other.

Metric: Domain success under a published trial policy
Tasks: Airline customer-service tasks
Authors: Victor Barres, Honghua Dong, Soham Ray, Xujie Si, Karthik Narasimhan (2025)
Source: τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment ↗

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.