Skip to content

WebArena Web Agent Benchmark

WebArena tests whether a browser-agent system can complete 812 long-horizon tasks inside self-hosted replicas of functional websites. It checks the requested end state, so a result reflects the model, agent scaffold, browser interface, action budget, and evaluator together—not the base model alone.

1 models

Higher is better.

  1. 1Nemotron 3.5 Bolt 74B-A9BNVIDIA50.9
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
End-state task success
Tasks
812 long-horizon browser tasks
Authors
Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, Graham Neubig (2024)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.