Skip to content

Llama 3.1 70B

MetaOpen weightsNon-reasoningReleased Jul 23, 2024
Overall score
—
Not enough evidence to rank yet
Context window
128K
128,000 tokens
Price per 1M tokens
— in · — out
No price listed
Blended price
—
3:1 input:output tokens
Output speed
—
Not measured yet

Category scores

Scores per capability area with the model's rank among ranked models in that category.

  1. 1Knowledge56.4
Higher is better. #N is the model's rank in that category, where it is eligible to be ranked.

Benchmark results (7)

As reported in system cards, papers and public evaluations. Position compares this model with every other model reporting the same benchmark.

Knowledge

GPQA46.7#103 of 117
MMLU-Pro66.4#55 of 67
MMLU86.0#11 of 28

Coding

HumanEval80.5#12 of 18

Multilingual

MGSM86.9#3 of 11

Instruction following

IFEval87.5#27 of 53

Math

GSM8K95.1#2 of 6

Pricing by source

USD per 1M tokens.

SourceInputOutputCached in
List price———

Open weights

From the Hugging Face repository.

Parameters
71B
Licence
llama3.1
Downloads (30 days)
43K

Speed

Measured by us through OpenRouter (median of trials).

Not available on OpenRouter, so we cannot measure it yet.

Related models

Same family