Skip to content

BigCodeBench

A code-generation benchmark reported in DeepSeek-V4 base-model evaluations.

1 models

Higher is better.

  1. 1Ternary Bonsai 2 27BPrism ML58.1
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
Pass@1
Tasks
Code generation tasks
Authors
DeepSeek-AI (2026)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.