Skip to content

Toolathlon Verified Pass cubed

Fraction of Toolathlon Verified tasks solved in all three independent trials.

4 models

Higher is better.

  1. 1Claude Fable 5.1Anthropic73.1
  2. 2Claude Opus 5Anthropic73.1
  3. 3Claude Opus 5.5Anthropic72.2
  4. 4Claude Sonnet 5.5Anthropic68.5
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
All-three-trials pass rate
Tasks
108 verified real-world tool-use tasks
Authors
Anthropic (2026)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.