Skip to content

Phi-3.5-mini

MicrosoftOpen weightsNon-reasoningReleased Aug 1, 2024
Overall score
—
Not enough evidence to rank yet
Context window
128K
128,000 tokens
Price per 1M tokens
— in · — out
No price listed
Blended price
—
3:1 input:output tokens
Output speed
—
Not measured yet

Category scores

Scores per capability area with the model's rank among ranked models in that category.

  1. 1Knowledge39.6
Higher is better. #N is the model's rank in that category, where it is eligible to be ranked.

Benchmark results (8)

As reported in system cards, papers and public evaluations. Position compares this model with every other model reporting the same benchmark.

Knowledge

GPQA30.4#111 of 117
MMLU-Pro47.4#61 of 67
MMLU69.0#25 of 28
MMMLU55.4#11 of 11

Coding

HumanEval62.8#16 of 18

Reasoning

BBH69.0#4 of 7

Multilingual

MGSM47.9#8 of 11

Math

GSM8K86.2#4 of 6

Pricing by source

USD per 1M tokens.

SourceInputOutputCached in
List price———

Speed

Measured by us through OpenRouter (median of trials).

Not available on OpenRouter, so we cannot measure it yet.

Related models

Same family