Skip to content

HLE-Verified

A verified and revised Humanity's Last Exam set that removes uncertain items and repairs fixable questions before evaluating frontier expert reasoning.

6 models

Higher is better.

  1. 1Gemini 3.8 FlashGoogle54.9
  2. 2GPT-5.6 SolOpenAI54.5
  3. 3Claude Opus 5Anthropic54.4
  4. 4Gemini 3.7 FlashGoogle53.6
  5. 5GPT-5.6 TerraOpenAI51.1
  6. 6Claude Sonnet 5Anthropic31.0
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
Full-set accuracy
Tasks
1,811 verified or revised expert questions
Authors
Weiqi Zhai, Zhihai Wang, Jinghang Wang, Boyu Yang, Xiaogang Li, Xiang Xu, Bohan Wang, Peng Wang, Xingzhe Wu, Anfeng Li, Qiyuan Feng, Yuhao Zhou, Shoulin Han, Wenjie Luo, Yiyuan Li, Yaxuan Wang, Ruixian Luo, Guojie Lin, Peiyao Xiao, Chengliang Xu, Ben Wang, Zeyu Wang, Zichao Chen, Jianan Ye, Yijie Hu, Jialong Chen, Zongwen Shen, Yuliang Xu, An Yang, Bowen Yu, Dayiheng Liu, Junyang Lin, Hu Wei, Que Shen, Bing Zhao (2026)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.