Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on Spider

92.2Exec Acc (All)

IQuest-Coder-V1-40B-Instruct

Updated 24d ago

Evaluation Results

Method
IQuest-Coder-V1-40B-Instruct 2026.03	92.2	-	-	-	-	-
Gemini-3-Flash-preview 2026.03	87.2	-	-	-	-	-
Gemini-3-Pro-preview 2026.03	87	-	-	-	-	-
SQL-O1 2026.02	86.54	-	-	-	-	-
LinkAlign 2026.02	85.89	-	-	-	-	-
SQL-O1 2026.02	85.25	-	-	-	-	-
SQL-O1 2026.02	85.1	-	-	-	-	-
DTS-SQL 2026.02	85.09	-	-	-	-	-
DTS-SQL 2026.02	84.99	-	-	-	-	-
Alpha-SQL 2026.02	84.93	-	-	-	-	-
Alpha-SQL 2026.02	84.37	-	-	-	-	-
DTS-SQL 2026.02	84.12	-	-	-	-	-
Alpha-SQL 2026.02	84	-	-	-	-	-
IQuest-Coder-V1-40B-Loop-Instruct 2026.03	84	-	-	-	-	-
Qwen2.5-Coder-32B-Instruct 2026.03	83.9	-	-	-	-	-
IESR 2026.02	83.45	-	-	-	-	-
IESR 2026.02	83.36	-	-	-	-	-
CHESS-SQL 2026.02	83.3	-	-	-	-	-
DTS-SQL 2026.02	83.21	-	-	-	-	-
DAIL-sql 2026.02	82.98	-	-	-	-	-
DAIL-sql 2026.02	82.56	-	-	-	-	-
LLaDA2.0-flash 2026.02	82.49	-	-	-	-	4.42
LinkAlign 2026.02	82.32	-	-	-	-	-
LinkAlign 2026.02	82.12	-	-	-	-	-
Qwen3-30B-A3B-Inst-2507 2026.02	81.79	-	-	-	-	1
DAIL-sql 2026.02	81.56	-	-	-	-	-
CHESS-SQL 2026.02	81.31	-	-	-	-	-
Qwen2.5-Coder-14B-Instruct 2026.03	81.3	-	-	-	-	-
Qwen3-Coder-480B-A35B-Instruct 2026.03	81.2	-	-	-	-	-
SQL-O1 2026.02	81.12	-	-	-	-	-
Qwen3-235B-A22B-Instruct-2507 2026.03	81.1	-	-	-	-	-
Kimi-K2-Instruct-0905 2026.03	81.1	-	-	-	-	-
LLaDA2.1-flash 2026.02	81.04	-	-	-	-	5.7
Qwen3-Coder-30B-A3B-Instruct 2026.03	80.9	-	-	-	-	-
Ling-flash-2.0 2026.02	80.58	-	-	-	-	1
DAIL-sql 2026.02	80.31	-	-	-	-	-
CHESS-SQL 2026.02	80.31	-	-	-	-	-
LinkAlign 2026.02	80.11	-	-	-	-	-
Claude-Sonnet-4.5 2026.03	80.1	-	-	-	-	-
IESR 2026.02	80.02	-	-	-	-	-
Qwen2.5-Coder-7B-Instruct 2026.03	79.8	-	-	-	-	-
Alpha-SQL 2026.02	79.34	-	-	-	-	-
Din-sql 2026.02	79.3	-	-	-	-	-
IESR 2026.02	79.22	-	-	-	-	-
LLaDA2.1-flash 2026.02	79.18	-	-	-	-	8.74
IQuest-Coder-V1-40B-Thinking 2026.03	78.1	-	-	-	-	-
Din-sql 2026.02	78.01	-	-	-	-	-
DeepSeek-v3.2 2026.03	77.9	-	-	-	-	-
IQuest-Coder-V1-40B-Loop-Thinking 2026.03	77.8	-	-	-	-	-
KAT-Dev 2026.03	77.6	-	-	-	-	-
GPT-5.1 2026.03	77.6	-	-	-	-	-
LLaDA2.1-mini 2026.02	77.55	-	-	-	-	5.48
Din-sql 2026.02	77.19	-	-	-	-	-
CHESS-SQL 2026.02	77.02	-	-	-	-	-
Din-sql 2026.02	76.8	-	-	-	-	-
LLaDA2.0-mini 2026.02	76.76	-	-	-	-	3.93
Ling-mini-2.0 2026.02	76.43	-	-	-	-	-
Claude-Opus-4.5 2026.03	76	-	-	-	-	-
IQuest-Coder-V1-14B-Instruct 2026.03	75.8	-	-	-	-	-
LLaDA2.1-mini 2026.02	75.78	-	-	-	-	7.98
Qwen3-8B 2026.02	72.8	-	-	-	-	-
Seed-Coder-8B-Instruct 2026.03	72.7	-	-	-	-	-
DeepSeek-Coder-V2-Lite-Instruct 2026.03	72.4	-	-	-	-	-
Table-Specialist 2024.10	70.4	-	-	-	-	-
GPT-4 2024.10	69.4	-	-	-	-	-
IQuest-Coder-V1-14B-Thinking 2026.03	69.3	-	-	-	-	-
Cot-sql 2026.02	69.12	-	-	-	-	-
Table-Specialist 2024.10	69	-	-	-	-	-
Table-Specialist 2024.10	68.4	-	-	-	-	-
Cot-sql 2026.02	68.32	-	-	-	-	-
IQuest-Coder-V1-7B-Instruct 2026.03	67.7	-	-	-	-	-
Llama3.1-8B 2024.10	67	-	-	-	-	-
Cot-sql 2026.02	66.23	-	-	-	-	-
Full Fine-tuning (All) 2025.03	66.2	84.3	69.5	53.4	43.4	-
Cot-sql 2026.02	65.32	-	-	-	-	-
GPT-3.5 2024.10	65	-	-	-	-	-
GLM-4.7 2026.03	62.4	-	-	-	-	-
KAT-Dev-72B-Exp 2026.03	60.3	-	-	-	-	-
State-offset Tuning (h) 2025.03	57.4	77.4	59.9	44.8	33.7	-
Full Fine-tuning (S6) 2025.03	56.7	76.6	57.8	46	34.9	-
IQuest-Coder-V1-7B-Thinking 2026.03	56.4	-	-	-	-	-
LoRA 2025.03	56.3	75	56.5	50.6	33.7	-
State-offset Tuning (y) 2025.03	53	77.4	55.4	40.8	22.9	-
Initial State Tuning 2025.03	51.8	77.8	51.1	35.1	32.5	-
BitFit 2025.03	51.3	74.2	50.9	43.1	26.5	-
Kimi-K2-Thinking 2026.03	49.6	-	-	-	-	-
Prompt Tuning 2025.03	43.6	65.3	42.4	33.3	25.3	-
Qwen3-235B-A22B-Thinking-2507 2026.03	42.6	-	-	-	-	-
Prefix-Tuning 2025.03	39.7	65.7	38.6	31	15.1	-
Additional-scan 2025.03	26.9	44.4	25.6	21.3	10.2	-
Pretrained 2025.03	0	0	0	0	0	-
Qwen3-8B 2025.12	-	-	-	-	86.07	-
TableLLM 2025.12	-	-	-	-	65.3	-
Llama-3.1-8B 2025.12	-	-	-	-	73.59	-
Table-R1-Zero-7B 2025.12	-	-	-	-	82.63	-
TableGPT2-7B 2025.12	-	-	-	-	74.38	-
TableGPT-R1-8B 2025.12	-	-	-	-	86.73	-
Qwen3-14B 2025.12	-	-	-	-	87.61	-
Qwen3-32B 2025.12	-	-	-	-	87.8	-
Qwen3-72B 2025.12	-	-	-	-	61.71	-

Showing 100 of 104 rows