Skip to content

GPT-4o mini

OpenAIProprietaryNon-reasoningVerifiedReleased Jul 18, 2024Input: text, image, file
Compare with Qwen2.5 Coder 32B InstructSource scores ↗OpenRouter ↗
Overall score
26.8
Rank 202 of 222 · 10.9–42.6
Context window
128K
128,000 tokens
Price per 1M tokens
$0.15 in · $0.60 out
Source: BenchLM
Blended price
$0.26
3:1 input:output tokens
Output speed
—
Not measured yet

Category scores

Scores per capability area with the model's rank among ranked models in that category.

  1. 1Instruction following#12934.7
  2. 2Multimodal29.8
Higher is better. #N is the model's rank in that category, where it is eligible to be ranked.

Benchmark results (2)

As reported in system cards, papers and public evaluations. Position compares this model with every other model reporting the same benchmark.

Coding

HumanEval87.2#10 of 18

Knowledge

MMLU82.0#18 of 28

Pricing by source

USD per 1M tokens.

SourceInputOutputCached in
List price (BenchLM)$0.15$0.60—
OpenRouter openai/gpt-4o-mini$0.15$0.60$0.075

OpenAI's GPT-4o mini model page lists $0.15 input / $0.60 output per million tokens.

Arena ratings

Human-preference ratings from LMArena. Best-rated variant shown.

Vision(2024-07-18)1066#137 · 17.3K votes

Speed

Measured by us through OpenRouter (median of trials).

Not measured yet.

Related models

Same family

Similar score