Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on Spider

98.65Exec Acc (All)

SQLCoder

Updated 1d ago

Evaluation Results

Method
SQLCoder 2026.05	98.65	-	-	-	-	-
Llama 3.1 2026.05	98.38	-	-	-	-	-
Gemma 3 2026.05	98.38	-	-	-	-	-
SQLCoder 2026.05	98.38	-	-	-	-	-
Gemma 3 2026.05	98.38	-	-	-	-	-
Qwen 3 2026.05	98.11	-	-	-	-	-
Llama 3.1 2026.05	98.11	-	-	-	-	-
Qwen 3 2026.05	95.14	-	-	-	-	-
IQuest-Coder-V1-40B-Instruct 2026.03	92.2	-	-	-	-	-
CHASE-SQL + Gemini 1.5 2025.10	87.6	-	-	-	-	-
Gemini-3-Flash-preview 2026.03	87.2	-	-	-	-	-
Gemini-3-Pro-preview 2026.03	87	-	-	-	-	-
SQL-O1 2026.02	86.54	-	-	-	-	-
DAIL-SQL + GPT-4 2025.10	86.2	-	-	-	-	-
LinkAlign 2026.02	85.89	-	-	-	-	-
SQL-O1 2026.02	85.25	-	-	-	-	-
SQL-O1 2026.02	85.1	-	-	-	-	-
DTS-SQL 2026.02	85.09	-	-	-	-	-
DTS-SQL 2026.02	84.99	-	-	-	-	-
Alpha-SQL 2026.02	84.93	-	-	-	-	-
Alpha-SQL 2026.02	84.37	-	-	-	-	-
Qwen3-4B + Long-Horizon Training (Ours) 2025.10	84.2	-	-	-	-	-
DTS-SQL 2026.02	84.12	-	-	-	-	-
Alpha-SQL 2026.02	84	-	-	-	-	-
IQuest-Coder-V1-40B-Loop-Instruct 2026.03	84	-	-	-	-	-
Qwen2.5-Coder-32B-Instruct 2026.03	83.9	-	-	-	-	-
IESR 2026.02	83.45	-	-	-	-	-
IESR 2026.02	83.36	-	-	-	-	-
CHESS-SQL 2026.02	83.3	-	-	-	-	-
DTS-SQL 2026.02	83.21	-	-	-	-	-
DAIL-sql 2026.02	82.98	-	-	-	-	-
DAIL-sql 2026.02	82.56	-	-	-	-	-
LLaDA2.0-flash 2026.02	82.49	-	-	-	-	4.42
LinkAlign 2026.02	82.32	-	-	-	-	-
LinkAlign 2026.02	82.12	-	-	-	-	-
Qwen3-30B-A3B-Inst-2507 2026.02	81.79	-	-	-	-	1
DAIL-sql 2026.02	81.56	-	-	-	-	-
CHESS-SQL 2026.02	81.31	-	-	-	-	-
Qwen2.5-Coder-14B-Instruct 2026.03	81.3	-	-	-	-	-
Qwen3-Coder-480B-A35B-Instruct 2026.03	81.2	-	-	-	-	-
SQL-O1 2026.02	81.12	-	-	-	-	-
Qwen3-235B-A22B-Instruct-2507 2026.03	81.1	-	-	-	-	-
Kimi-K2-Instruct-0905 2026.03	81.1	-	-	-	-	-
LLaDA2.1-flash 2026.02	81.04	-	-	-	-	5.7
Qwen3-Coder-30B-A3B-Instruct 2026.03	80.9	-	-	-	-	-
Ling-flash-2.0 2026.02	80.58	-	-	-	-	1
DAIL-sql 2026.02	80.31	-	-	-	-	-
CHESS-SQL 2026.02	80.31	-	-	-	-	-
LinkAlign 2026.02	80.11	-	-	-	-	-
Claude-Sonnet-4.5 2026.03	80.1	-	-	-	-	-
IESR 2026.02	80.02	-	-	-	-	-
Qwen2.5-Coder-7B-Instruct 2026.03	79.8	-	-	-	-	-
Alpha-SQL 2026.02	79.34	-	-	-	-	-
Din-sql 2026.02	79.3	-	-	-	-	-
IESR 2026.02	79.22	-	-	-	-	-
LLaDA2.1-flash 2026.02	79.18	-	-	-	-	8.74
IQuest-Coder-V1-40B-Thinking 2026.03	78.1	-	-	-	-	-
Din-sql 2026.02	78.01	-	-	-	-	-
RESDSQL-3B + NatSQ 2025.10	78	-	-	-	-	-
DeepSeek-v3.2 2026.03	77.9	-	-	-	-	-
IQuest-Coder-V1-40B-Loop-Thinking 2026.03	77.8	-	-	-	-	-
PV-SQL 2026.04	77.66	-	-	-	-	-
KAT-Dev 2026.03	77.6	-	-	-	-	-
GPT-5.1 2026.03	77.6	-	-	-	-	-
LLaDA2.1-mini 2026.02	77.55	-	-	-	-	5.48
Din-sql 2026.02	77.19	-	-	-	-	-
CHESS-SQL 2026.02	77.02	-	-	-	-	-
Din-sql 2026.02	76.8	-	-	-	-	-
LLaDA2.0-mini 2026.02	76.76	-	-	-	-	3.93
Ling-mini-2.0 2026.02	76.43	-	-	-	-	-
Claude-Opus-4.5 2026.03	76	-	-	-	-	-
IQuest-Coder-V1-14B-Instruct 2026.03	75.8	-	-	-	-	-
LLaDA2.1-mini 2026.02	75.78	-	-	-	-	7.98
E-SQL 2026.04	75.63	-	-	-	-	-
TA-SQL 2026.04	74.66	-	-	-	-	-
TS-SQL 2026.04	74.18	-	-	-	-	-
Qwen3-14B 2025.10	72.9	-	-	-	-	-
Qwen3-8B 2026.02	72.8	-	-	-	-	-
MAC-SQL 2026.04	72.73	-	-	-	-	-
XiYan-SQL 2026.04	72.73	-	-	-	-	-
Seed-Coder-8B-Instruct 2026.03	72.7	-	-	-	-	-
DeepSeek-Coder-V2-Lite-Instruct 2026.03	72.4	-	-	-	-	-
DAIL-SQL 2026.04	71.18	-	-	-	-	-
GPT-4o 2026.04	71.08	-	-	-	-	-
Qwen3-4B 2025.10	70.7	-	-	-	-	-
Table-Specialist 2024.10	70.4	-	-	-	-	-
GPT-4 2024.10	69.4	-	-	-	-	-
IQuest-Coder-V1-14B-Thinking 2026.03	69.3	-	-	-	-	-
Cot-sql 2026.02	69.12	-	-	-	-	-
DIN-SQL 2026.04	69.05	-	-	-	-	-
Table-Specialist 2024.10	69	-	-	-	-	-
Table-Specialist 2024.10	68.4	-	-	-	-	-
Cot-sql 2026.02	68.32	-	-	-	-	-
IQuest-Coder-V1-7B-Instruct 2026.03	67.7	-	-	-	-	-
Llama3.1-8B 2024.10	67	-	-	-	-	-
Oracle 2026.04	66.6	-	-	-	-	-
Cot-sql 2026.02	66.23	-	-	-	-	-
Full Fine-tuning (All) 2025.03	66.2	84.3	69.5	53.4	43.4	-
Cot-sql 2026.02	65.32	-	-	-	-	-
GPT-3.5 2024.10	65	-	-	-	-	-

Showing 100 of 152 rows