Skip to content

American Invitational Mathematics Examination 2024

The 2024 edition of AIME, maintaining the same format of 15 challenging mathematics problems with integer answers from 000 to 999.

19 models

Higher is better.

  1. 1GPT-OSS 120BOpenAI95.8
  2. 2DeepSeek V3.1 (Reasoning)DeepSeek93.1
  3. 3GPT-OSS 20BOpenAI92.1
  4. 4Gemini 2.5 ProGoogle92.0
  5. 5Grok 3 MinixAI89.5
  6. 6o3-miniOpenAI87.3
  7. 7MiniMax M1 80kMiniMax86.0
  8. 8DeepSeek-R1DeepSeek79.8
  9. 9QwQ-32BAlibaba79.5
  10. 10Phi-4-reasoningMicrosoft75.3
  11. 11Magistral MediumMistral73.6
  12. 12Kimi K2Moonshot AI69.6
  13. 13DeepSeek V3.1DeepSeek66.3
  14. 14Grok 3 [Beta]xAI52.2
  15. 15Qwen3 235B-A22BAlibaba40.1
  16. 16DeepSeek V3DeepSeek39.2
  17. 17Qwen3 32BAlibaba31.0
  18. 18Claude 3.7 SonnetAnthropic23.3
  19. 19Claude 3.5 HaikuAnthropic5.3
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
Integer answers 000-999
Tasks
15 problems
Authors
Mathematical Association of America (2024)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.