Skip to content

Claude 3 Haiku

AnthropicProprietaryNon-reasoningVerifiedReleased Mar 1, 2024
Compare with Gemini 1.0 ProSource scores ↗
Overall score
14.1
Rank 218 of 222 · 5.7–22.5
Context window
200K
200,000 tokens
Price per 1M tokens
$0.25 in · $1.25 out
Source: BenchLM
Blended price
$0.50
3:1 input:output tokens
Output speed
—
Not measured yet

Category scores

Scores per capability area with the model's rank among ranked models in that category.

  1. 1Reasoning44.0
  2. 2Instruction following#11641.3
  3. 3Knowledge39.7
  4. 4Multimodal29.8
Higher is better. #N is the model's rank in that category, where it is eligible to be ranked.

Benchmark results (0)

As reported in system cards, papers and public evaluations. Position compares this model with every other model reporting the same benchmark.

No benchmark results with redistributable sources yet.

Pricing by source

USD per 1M tokens.

SourceInputOutputCached in
List price (BenchLM)$0.25$1.25—

Anthropic's pricing docs list Claude Haiku 3 at $0.25 input / $1.25 output per million tokens.

Arena ratings

Human-preference ratings from LMArena. Best-rated variant shown.

Vision(20240307)950#159 · 13.4K votes

Speed

Measured by us through OpenRouter (median of trials).

Not available on OpenRouter, so we cannot measure it yet.

Related models

Similar score