Spider 2.0-Lite

A text-to-SQL benchmark over realistic warehouse-scale schemas, reported by Interfaze for model comparison.

1 models

Higher is better.

Higher is better. Bar colour: blue proprietary, orange open weights, green other.

Metric: Execution accuracy
Tasks: Text-to-SQL queries
Authors: Spider 2.0 authors (2024)
Source: Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows ↗

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.