o1
OpenAIProprietaryReasoningProvisionalReleased Dec 1, 2024Input: text, image, file
Overall score
38.3
Rank 148 of 222 · 24.0–52.7
Context window
200K
200,000 tokens
Price per 1M tokens
$15.00 in · $60.00 out
Source: BenchLM
Blended price
$26.25
3:1 input:output tokens
Output speed
—
Not measured yet
Category scores
Scores per capability area with the model's rank among ranked models in that category.
- 1Instruction following#4686.0
- 2Reasoning69.7
- 3Knowledge63.3
- 4Math33.5
Benchmark results (4)
As reported in system cards, papers and public evaluations. Position compares this model with every other model reporting the same benchmark.
Knowledge
| GPQA | 75.7 | #67 of 117 |
| MMLU | 91.8 | #1 of 28 |
Instruction following
| IFEval | 92.2 | #14 of 53 |
Math
| FrontierMath v2 (Tiers 1-3) | 14.737 | #61 of 64 |
Pricing by source
USD per 1M tokens.
| Source | Input | Output | Cached in |
|---|---|---|---|
| List price (BenchLM) | $15.00 | $60.00 | — |
| OpenRouter openai/o1 | $15.00 | $60.00 | $7.50 |
OpenAI's o1 model page lists $15.00 input / $60.00 output per million tokens.
Arena ratings
Human-preference ratings from LMArena. Best-rated variant shown.
| Vision(2024-12-17) | 1168 | #111 · 3.7K votes |
Speed
Measured by us through OpenRouter (median of trials).
Not measured yet.
Related models
Same family
- o1-pro35.8
- o1-preview36.0
Similar score
- Claude 4 Sonnet38.1 · $6.00
- LFM2.5-24B-A2B37.7 · $0.33
- GPT-4.137.6 · $3.50
- GLM-4.7-Flash39.1 · $0.15
- DeepSeek V3.1 (Reasoning)39.1 · —