FrontierMath v2 Tiers 1-3
Epoch AI's corrected v2 core FrontierMath suite of private advanced mathematics problems. Models can reason iteratively and use Python; scores are pass rates on the private set.
64 models
Higher is better.
- 1GPT-6.1 SolOpenAI93.684
- 2GPT-6 AstraOpenAI93.684
- 3Claude Opus 5.5Anthropic91.228
- 4Claude Fable 5.1Anthropic90.175
- 5GPT-6 SolOpenAI89.825
- 6GPT-5.6 SolOpenAI89.000
- 7Claude Sonnet 5.5Anthropic88.772
- 8GPT-5.5 ProOpenAI87.719
- 9Claude Fable 5Anthropic87.018
- 10Gemini 4 ArgonGoogle85.965
- 11Claude Opus 5Anthropic85.614
- 12GPT-5.5OpenAI85.263
- 13GPT-5.6 TerraOpenAI84.900
- 14GPT-5.4 ProOpenAI82.456
- 15Claude Opus 4.8Anthropic80.000
- 16GPT-6 LunaOpenAI78.947
- 17GPT-5.6 LunaOpenAI78.600
- 18GPT-5.4OpenAI78.596
- 19Claude Haiku 5.5Anthropic75.088
- 20Qwen3.8 MaxAlibaba74.737
- 21Muse Spark 1.3Meta74.035
- 22Gemini 3.7 FlashGoogle71.579
- 23Claude Opus 4.7Anthropic70.175
- 24GLM-5.3Z.AI68.772
- 25Gemini 3.8 FlashGoogle68.421
- 26GPT-5.2OpenAI67.400
- 27DeepSeek V4.1 Flash 1017DeepSeek67.368
- 28Grok 4.6xAI65.965
- 29Claude Opus 4.6Anthropic65.965
- 30Claude Sonnet 5Anthropic65.614
- 31Qwen3.7 MaxAlibaba64.561
- 32Gemini 3.5 FlashGoogle62.807
- 33Gemini 3.1 ProGoogle59.649
- 34GLM-5.2Z.AI59.206
- 35Gemini 3.6 FlashGoogle58.947
- 36Grok 4.5xAI57.193
- 37Kimi K2.6Moonshot AI57.193
- 38GLM-5.3-FlashZ.AI55.789
- 39Kimi K2.7 CodeMoonshot AI54.035
- 40Grok 4.7xAI52.982
About this benchmark
- Metric
- Python-enabled iterative mathematical problem solving
- Tasks
- 285 private advanced mathematics problems
- Authors
- Epoch AI (2026)
Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.
All results
| 1 | GPT-6.1 Sol OpenAI | 93.684 |
| 2 | GPT-6 Astra OpenAI | 93.684 |
| 3 | Claude Opus 5.5 Anthropic | 91.228 |
| 4 | Claude Fable 5.1 Anthropic | 90.175 |
| 5 | GPT-6 Sol OpenAI | 89.825 |
| 6 | GPT-5.6 Sol OpenAI | 89.000 |
| 7 | Claude Sonnet 5.5 Anthropic | 88.772 |
| 8 | GPT-5.5 Pro OpenAI | 87.719 |
| 9 | Claude Fable 5 Anthropic | 87.018 |
| 10 | Gemini 4 Argon Google | 85.965 |
| 11 | Claude Opus 5 Anthropic | 85.614 |
| 12 | GPT-5.5 OpenAI | 85.263 |
| 13 | GPT-5.6 Terra OpenAI | 84.900 |
| 14 | GPT-5.4 Pro OpenAI | 82.456 |
| 15 | Claude Opus 4.8 Anthropic | 80.000 |
| 16 | GPT-6 Luna OpenAI | 78.947 |
| 17 | GPT-5.6 Luna OpenAI | 78.600 |
| 18 | GPT-5.4 OpenAI | 78.596 |
| 19 | Claude Haiku 5.5 Anthropic | 75.088 |
| 20 | Qwen3.8 Max Alibaba | 74.737 |
| 21 | Muse Spark 1.3 Meta | 74.035 |
| 22 | Gemini 3.7 Flash Google | 71.579 |
| 23 | Claude Opus 4.7 Anthropic | 70.175 |
| 24 | GLM-5.3 Z.AI | 68.772 |
| 25 | Gemini 3.8 Flash Google | 68.421 |
| 26 | GPT-5.2 OpenAI | 67.400 |
| 27 | DeepSeek V4.1 Flash 1017 DeepSeek | 67.368 |
| 28 | Grok 4.6 xAI | 65.965 |
| 29 | Claude Opus 4.6 Anthropic | 65.965 |
| 30 | Claude Sonnet 5 Anthropic | 65.614 |
| 31 | Qwen3.7 Max Alibaba | 64.561 |
| 32 | Gemini 3.5 Flash Google | 62.807 |
| 33 | Gemini 3.1 Pro Google | 59.649 |
| 34 | GLM-5.2 Z.AI | 59.206 |
| 35 | Gemini 3.6 Flash Google | 58.947 |
| 36 | Grok 4.5 xAI | 57.193 |
| 37 | Kimi K2.6 Moonshot AI | 57.193 |
| 38 | GLM-5.3-Flash Z.AI | 55.789 |
| 39 | Kimi K2.7 Code Moonshot AI | 54.035 |
| 40 | Grok 4.7 xAI | 52.982 |
| 41 | Gemini 3 Flash Google | 51.228 |
| 42 | GPT-5.4 mini OpenAI | 51.228 |
| 43 | Inkling-Small Thinking Machines Lab | 46.316 |
| 44 | GPT-5.4 nano OpenAI | 44.912 |
| 45 | Grok 4.3 xAI | 42.807 |
| 46 | Qwen3.6 Plus Alibaba | 38.246 |
| 47 | GLM-5.1 Z.AI | 36.842 |
| 48 | o4-mini (high) OpenAI | 36.140 |
| 49 | Qwen3.6-27B Alibaba | 35.088 |
| 50 | Claude Opus 4.5 Anthropic | 34.386 |
| 51 | Qwen3.7 Plus Alibaba | 34.386 |
| 52 | Inkling Thinking Machines Lab | 33.333 |
| 53 | o3 OpenAI | 33.333 |
| 54 | Gemini 3.1 Flash-Lite Google | 27.719 |
| 55 | Gemini 3.5 Flash-Lite Google | 25.965 |
| 56 | Gemini 2.5 Pro Google | 24.561 |
| 57 | Claude Sonnet 4.5 Anthropic | 23.860 |
| 58 | Qwen3.6-35B-A3B Alibaba | 20.351 |
| 59 | Qwen3.7 Flash Alibaba | 19.298 |
| 60 | Qwen3.5 Flash Alibaba | 18.246 |
| 61 | o1 OpenAI | 14.737 |
| 62 | GPT-4.1 mini OpenAI | 6.667 |
| 63 | GPT-4.1 OpenAI | 5.965 |
| 64 | GPT-4o OpenAI | 0.351 |