Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on Spider Lite 2.0

69.3Execution Accuracy (EX)

SOMA-SQL

Updated 1mo ago

Evaluation Results

Method	Links
SOMA-SQL 2026.06		69.3
SOMA-SQL 2026.06		65.8
ProSpy 2026.06		60.15
SOMA-SQL 2026.06		53.7
SquRL-7B 2026.02		49.18
ProSpy 2026.06		48.63
AutoLink 2026.06		46.3
AutoLink 2026.06		45.2
ProSpy 2026.06		43.14
ProSpy 2026.06		41.32
ProSpy 2026.06		38.21
AutoLink 2026.06		37.7
ReForce 2026.06		36.56
AutoLink 2026.06		34.92
DeepEye-SQL 2026.06		33.6
LinkAlign 2026.02		33.09
RSL-SQL 2026.02		33.09
LinkAlign 2026.06		33.09
RSL-SQL 2026.06		33.09
ReForce 2026.06		31.99
DeepEye-SQL 2026.06		31.4
RSL-SQL 2026.06		30.53
Spider-Agent 2026.06		27.79
DeepEye-SQL 2026.06		24
Agentic SQL + CSMR + ATR 2026.03		17.7
GPT-4o 2026.03		15.6
Deepseek-V3 2026.03		15.6
Arctic-Text2SQL-R1-7B 2026.03		15.6
SQL-R1 + OmniSQL-7B 2026.03		14.8
Single-Turn GRPO 2026.03		14.8
Spider-Agent 2026.06		13.71
OmniSQL-7B 2026.03		12.6
Agentic SQL + CSMR + ATR 2026.03		8.8
ATR 2026.03		8.8
Agentic SQL + CSMR 2026.03		8.1
ATR w/ Step-wise Update 2026.03		8.1
Agentic SQL + ATR 2026.03		7.4
ATR w/ Symmetric Matrix 2026.03		7.4
Single-Turn GRPO 2026.03		6.6
Single-Turn GRPO + CSMR 2026.03		6.6
Agentic SQL 2026.03		5.9
DailSQL 2026.02		5.68
Qwen2.5-7B-Instruct 2026.03		5.1
CHESS 2026.02		3.83
Qwen2.5-Coder-7B 2026.03		2.2
DIN-SQL 2026.02		1.46