Text-to-SQL on BIRD (Execution Accuracy EX)

73Execution Accuracy

CHASE-SQL + Gemini 1.5

Updated 22d ago

Evaluation Results

Method	Links
CHASE-SQL + Gemini 1.5 2025.10		73
PV-SQL 2026.04		65.1
LearNAT 2025.04		65
PV-SQL (w/o Probe) 2026.04		62.1
PV-SQL (w/o Repair) 2026.04		61.8
LearNAT 2025.04		61.2
TA-SQL 2026.04		60.43
MAC-SQL 2025.04		59.4
E-SQL 2026.04		59.1
PV-SQL (LLM verify) 2026.04		59.1
MAC-SQL 2026.04		58.7
SuperSQL 2025.04		58.5
CodeS 2025.04		58.5
LearNAT 2025.04		58.1
XiYan-SQL 2026.04		57.6
MAG-SQL 2025.04		57.6
TS-SQL 2026.04		57.4
SFT CodeS-7B 2025.10		57.1
CodeS 2025.04		57
Qwen3-4B + Long-Horizon Training (Ours) 2025.10		56.9
DeepSeek 2025.10		56.1
DIN-SQL 2026.04		54.8
DAIL-SQL + GPT-4 2025.10		54.76
DAIL-SQL 2025.04		54.3
DAIL-SQL 2026.04		54.1
ACT-SQL 2025.04		52.4
ZS-CoT 2026.04		52.2
DIN-SQL 2025.04		50.7
C3-SQL 2025.04		50.2
MetaSQL 2025.04		47.6
Qwen3-14B 2025.10		32.6
Qwen3-4B 2025.10		25.8
T5-3B 2025.10		23.3