Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on BIRD (EX, VES)

65.12Execution Accuracy (EX)

PV-SQL

Updated 1mo ago

Evaluation Results

Method
PV-SQL 2026.04	65.12	75.55
PV-SQL 2026.04	65.12	75.55
PV-SQL 2026.04	63.62	86.9
TA-SQL 2026.04	60.43	62.99
TA-SQL 2026.04	60.43	62.99
TA-SQL 2026.04	60.2	66.11
PV-SQL 2026.04	59.45	61.99
E-SQL 2026.04	59.1	64.65
E-SQL 2026.04	59.1	64.65
MAC-SQL 2026.04	58.7	62.77
MAC-SQL 2026.04	58.7	62.77
XiYan-SQL 2026.04	57.6	63.96
XiYan-SQL 2026.04	57.6	63.96
TS-SQL 2026.04	57.37	63.43
TS-SQL 2026.04	57.37	63.43
TA-SQL 2026.04	55.74	55.51
MAC-SQL 2026.04	55.6	60.62
DIN-SQL 2026.04	54.8	56.75
DIN-SQL 2026.04	54.8	56.75
E-SQL 2026.04	54.8	60.95
DAIL-SQL 2026.04	54.1	58.77
DAIL-SQL 2026.04	54.1	58.77
E-SQL 2026.04	53.95	53.05
DIN-SQL 2026.04	53.8	58.22
MAC-SQL 2026.04	53.59	51.5
TS-SQL 2026.04	53.52	58.81
CoTE-SQL 2026.06	53.39	59.02
GPT-4o 2026.04	52.22	56.99
ZS-CoT 2026.04	52.22	56.99
XiYan-SQL 2026.04	51.6	58.99
TS-SQL 2026.04	50.98	55.2
ZS-CoT 2026.04	50.85	52.84
DAIL-SQL 2026.04	50.4	55.05
ZS-CoT 2026.04	50.26	53.75
DIN-SQL 2026.04	50.03	46.56
PV-SQL 2026.04	49.61	51.47
CoTE-SQL 2026.06	49.54	55.25
DAIL-SQL 2026.04	49.39	48.22
DAC 2026.06	46.54	48.25
GPT-4 2026.06	46.35	49.77
DAC 2026.06	45.57	48.32
Qwen2.5-7B 2026.06	45.44	48.37
MAC-SQL 2026.06	43.94	57.36
DTS-SQL 2026.06	42.18	44.43
DTS-SQL 2026.06	41.92	43.59
E-SQL 2026.04	41.66	46.38
Llama-3.1-8B 2026.06	41.2	46.58
DAIL-SQL 2026.06	41	43.82
DIN-SQL 2026.06	39.96	41.41
DAIL-SQL 2026.06	39.9	41.59
MAC-SQL 2026.04	39.76	40.88
PV-SQL 2026.04	39.5	42.39
DIN-SQL 2026.06	38.72	40.65
MAC-SQL 2026.04	37.7	37.36
ZS-CoT 2026.04	36.44	39.01
XiYan-SQL 2026.04	36.4	38.31
PURPLE 2026.06	36.31	42.33
XiYan-SQL 2026.04	35.98	38.03
ZS-CoT 2026.04	34.55	35.65
TA-SQL 2026.04	30.2	32.48
DAIL-SQL 2026.04	28.81	29.99
PURPLE 2026.06	28.49	-
TS-SQL 2026.04	27.4	31.47
DAIL-SQL 2026.04	27.32	27.41
E-SQL 2026.04	26.2	29.14
TS-SQL 2026.04	25.02	25.29
DIN-SQL 2026.04	23.44	22.51
TA-SQL 2026.04	23.01	22.71
DIN-SQL 2026.04	22.23	20.57
XiYan-SQL 2026.04	20.79	30.69
DeepSeek-R1-Llama-8B 2026.06	15.12	15.98
DEA-SQL 2026.06	13.17	14.93
ZS-CoT 2026.04	13.1	15.52
E-SQL 2026.04	12.84	13.06
MAC-SQL 2026.04	11.6	12.95
PV-SQL 2026.04	11.08	15.39
DEA-SQL 2026.06	8.41	8.35
DAIL-SQL 2026.04	8.15	8.5
DIN-SQL 2026.04	6.84	7.13
XiYan-SQL 2026.04	6.6	6.93
DeepSeek-R1-Qwen-7B 2026.06	6.17	7.05
TS-SQL 2026.04	5.6	8.48
TA-SQL 2026.04	3	3.16