Skip to content

PaperBench

A research-reproduction benchmark that asks agents to recreate the contributions of AI papers from the paper alone.

1 models

Higher is better.

  1. 1Qwen3.8 MaxAlibaba93.0
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
Long-horizon agent evaluation
Tasks
AI research-paper reproduction
Authors
Qwen Team (2026)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.