Skip to content

Claude 3.5 Sonnet

AnthropicProprietaryNon-reasoningProvisionalReleased Jun 1, 2024
Overall score
27.7
Rank 200 of 222 · 18.0–37.4
Context window
200K
200,000 tokens
Price per 1M tokens
$3.00 in · $15.00 out
Source: BenchLM
Blended price
$6.00
3:1 input:output tokens
Output speed
—
Not measured yet

Benchmark results (2)

As reported in system cards, papers and public evaluations. Position compares this model with every other model reporting the same benchmark.

Coding

SWE-bench Verified49.0#87 of 98

Knowledge

GPQA59.4#92 of 117

Pricing by source

USD per 1M tokens.

SourceInputOutputCached in
List price (BenchLM)$3.00$15.00—

Anthropic's pricing docs list Claude Sonnet 3.5 at $3 input / $15 output per million tokens.

Arena ratings

Human-preference ratings from LMArena. Best-rated variant shown.

Vision(20241022)1126#126 · 10.4K votes

Speed

Measured by us through OpenRouter (median of trials).

Not available on OpenRouter, so we cannot measure it yet.

Related models

Similar score