Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on BIRD

70.5Total Execution Accuracy

IQuest-Coder-V1-40B-Instruct

Updated 4d ago

Evaluation Results

Method
IQuest-Coder-V1-40B-Instruct 2026.03	70.5	-	-	-	-	-	-	-	-
IQuest-Coder-V1-40B-Loop-Instruct 2026.03	69.9	-	-	-	-	-	-	-	-
Qwen-Plus 2025.12	68.32	-	-	-	-	-	-	-	-
Gemini-3-Pro-preview 2026.03	67.5	-	-	-	-	-	-	-	-
Gemini-3-Flash-preview 2026.03	66.6	-	-	-	-	-	-	-	-
DCTR 2026.03	66.56	-	-	-	-	-	-	-	-
Baseline 2026.03	66.3	-	-	-	-	-	-	-	-
DCTR 2026.03	66.3	-	-	-	-	-	-	-	-
DCTR 2026.03	66.23	-	-	-	-	-	-	-	-
Claude-Opus-4.5 2026.03	66	-	-	-	-	-	-	-	-
DeepSeek-V3 2025.12	65.65	-	-	-	-	-	-	-	-
GPT-4o 2025.12	65.25	-	-	-	-	-	-	-	-
RSL-SQL 2025.12	64.67	71.68	55.6	48.97	-	-	-	-	-
TableGPT-R1-8B 2025.12	63.17	-	-	-	-	-	-	-	-
Qwen3-32B 2025.12	63.04	-	-	-	-	-	-	-	-
Qwen3-235B-A22B-Instruct-2507 2026.03	62.8	-	-	-	-	-	-	-	-
Claude-Sonnet-4.5 2026.03	62.5	-	-	-	-	-	-	-	-
CHESS 2025.12	62.14	67.38	56.82	47.06	-	-	-	-	-
Qwen2.5-Coder-32B-Instruct 2026.03	62.1	-	-	-	-	-	-	-	-
Qwen3-14B 2025.12	61.8	-	-	-	-	-	-	-	-
Qwen3-8B 2025.12	61.67	-	-	-	-	-	-	-	-
Qwen3-Coder-480B-A35B-Instruct 2026.03	61.3	-	-	-	-	-	-	-	-
Kimi-K2-Instruct-0905 2026.03	60.4	-	-	-	-	-	-	-	-
MAC-SQL 2026.02	59.59	-	-	-	-	-	-	67.68	-
Qwen2.5-Coder-14B-Instruct 2026.03	59.1	-	-	-	-	-	-	-	-
Qwen3-Coder-30B-A3B-Instruct 2026.03	59	-	-	-	-	-	-	-	-
DAIL-SQL 2025.12	57.89	63.78	51.72	40	-	-	-	-	-
DAIL-SQL 2026.02	57.41	-	-	-	-	-	-	61.95	-
RSL-SQL (CA) 2025.12	56.45	65.19	44.4	39.31	-	-	-	-	-
DIN-SQL 2026.02	55.9	-	-	-	-	-	-	59.44	-
Table-Specialist 2024.10	55.6	-	-	-	-	-	-	-	-
IQuest-Coder-V1-40B-Loop-Thinking 2026.03	54.8	-	-	-	-	-	-	-	-
QwQ-32B 2025.12	54.3	-	-	-	-	-	-	-	-
Qwen3-72B 2025.12	53.91	-	-	-	-	-	-	-	-
DAIL-SQL (CA) 2025.12	53.65	62.16	42.67	34.48	-	-	-	-	-
IQuest-Coder-V1-40B-Thinking 2026.03	53.6	-	-	-	-	-	-	-	-
GPT-5.1 2026.03	53.3	-	-	-	-	-	-	-	-
Qwen2.5-Coder-7B-Instruct 2026.03	53.1	-	-	-	-	-	-	-	-
GPT-4 2024.10	52.8	-	-	-	-	-	-	-	-
DeepSeek-v3.2 2026.03	52.6	-	-	-	-	-	-	-	-
KAT-Dev 2026.03	52.2	-	-	-	-	-	-	-	-
CHESS (CA) 2025.12	52.15	59.46	43.1	34.48	-	-	-	-	-
RSL-SQL 2025.12	51.96	61.41	40.09	29.66	-	-	-	-	-
Table-Specialist 2024.10	51.4	-	-	-	-	-	-	-	-
Table-R1-Zero-7B 2025.12	50.98	-	-	-	-	-	-	-	-
IQuest-Coder-V1-14B-Instruct 2026.03	50	-	-	-	-	-	-	-	-
TableGPT2-7B 2025.12	49.28	-	-	-	-	-	-	-	-
CHESS 2025.12	47.78	56	37.93	26.9	-	-	-	-	-
Proposed Agentic 2026.02	47.78	-	-	-	-	-	-	51.05	-
IQuest-Coder-V1-14B-Thinking 2026.03	46.9	-	-	-	-	-	-	-	-
GLM-4.7 2026.03	46.5	-	-	-	-	-	-	-	-
GPT-3.5 2024.10	45.2	-	-	-	-	-	-	-	-
Seed-Coder-8B-Instruct 2026.03	44.7	-	-	-	-	-	-	-	-
Table-Specialist 2024.10	43.8	-	-	-	-	-	-	-	-
DeepSeek-Coder-V2-Lite-Instruct 2026.03	41.6	-	-	-	-	-	-	-	-
Kimi-K2-Thinking 2026.03	40.6	-	-	-	-	-	-	-	-
Llama-3.1-8B 2025.12	40.03	-	-	-	-	-	-	-	-
DAIL-SQL 2025.12	39.52	38.76	27.39	17.77	-	-	-	-	-
Llama3.1-8B 2024.10	38.8	-	-	-	-	-	-	-	-
IQuest-Coder-V1-7B-Instruct 2026.03	37.7	-	-	-	-	-	-	-	-
Qwen3-235B-A22B-Thinking-2507 2026.03	35.2	-	-	-	-	-	-	-	-
KAT-Dev-72B-Exp 2026.03	35.2	-	-	-	-	-	-	-	-
TableLLM 2025.12	30.64	-	-	-	-	-	-	-	-
IQuest-Coder-V1-7B-Thinking 2026.03	30.5	-	-	-	-	-	-	-	-
ReAct 2025.09	-	-	-	-	50.2	62.39	-	-	-
ReAct 2025.09	-	-	-	-	57.04	66.88	-	-	-
ReAct 2025.09	-	-	-	-	55.8	66.17	-	-	-
ReAct 2025.09	-	-	-	-	57.89	68.12	-	-	-
ReAct 2025.09	-	-	-	-	60.17	65.19	-	-	-
ReAct 2025.09	-	-	-	-	41.2	60.17	-	-	-
ReAct 2025.09	-	-	-	-	50.3	64.21	-	-	-
ReAct 2025.09	-	-	-	-	59.1	68.58	-	-	-
ReAct 2025.09	-	-	-	-	60.3	69.49	-	-	-
ReAct 2025.09	-	-	-	-	7.02	18.71	-	-	-
TableLLM 2025.09	-	-	-	-	11.99	16.75	-	-	-
Table-R1 2025.09	-	-	-	-	10.69	13.49	-	-	-
OmniSQL 2025.09	-	-	-	-	57.11	66.3	-	-	-
SQL-R1 2025.09	-	-	-	-	56.78	66.23	-	-	-
DATAMIND 2025.09	-	-	-	-	59.41	69.88	-	-	-
ReAct 2025.09	-	-	-	-	41.76	59.91	-	-	-
TableLLM 2025.09	-	-	-	-	20.99	28.88	-	-	-
Table-R1 2025.09	-	-	-	-	11.8	14.08	-	-	-
OmniSQL 2025.09	-	-	-	-	58.8	67.41	-	-	-
SQL-R1 2025.09	-	-	-	-	58.02	66.62	-	-	-
DATAMIND 2025.09	-	-	-	-	62.23	70.21	-	-	-
GRPO 2026.03	-	-	-	-	59.4	-	68.4	-	-
DAPO 2026.03	-	-	-	-	60.1	-	69.2	-	-
DPH-RL 2026.03	-	-	-	-	62.8	-	72.4	-	-
DyJR 2026.03	-	-	-	-	62.7	-	72.9	-	-
Nemotron 3 Super 2026.04	-	-	-	-	-	-	-	-	41.8
GPT-OSS-120B 2026.04	-	-	-	-	-	-	-	-	38.25