Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on Spider-Syn

83.1Execution Accuracy (EX)

FineStep-4B

Updated 1mo ago

Evaluation Results

Method
FineStep-4B 2026.05	83.1	-	-	-	-	75.2
FineStep 2026.05	83.1	-	-	-	-	75.2
EXPO-SQL 2026.04	83.1	-	-	-	-	-
FineStep-8B 2026.05	81.4	-	-	-	-	71.6
FineStep 2026.05	81.4	-	-	-	-	71.6
MTIR-SQL + Qwen3-14B 2026.05	81	-	-	-	-	-
FineStep 2026.05	80.8	-	-	-	-	72.6
GIGPO 2026.05	80.4	-	-	-	-	71.7
GIGPO 2026.05	80.2	-	-	-	-	71.7
GSPO 2026.05	80.1	-	-	-	-	72.1
DAPO 2026.05	80	-	-	-	-	72.5
GSPO 2026.05	79.6	-	-	-	-	70.3
GRPO 2026.05	79.6	-	-	-	-	70.4
DAPO 2026.05	79.5	-	-	-	-	71.1
GRPO 2026.05	79.2	-	-	-	-	70
Reward-SQL + Qwen3-8B 2025.05	79	-	-	-	-	-
GRPO 2026.05	78.9	-	-	-	-	71.2
DCG-SQL 2025.05	78.7	68.6	-	-	-	-
ReEx-SQL-7B 2026.05	78.7	-	-	-	-	72
Think2SQL-14B 2025.04	78.6	-	-	-	-	-
SENSE-13B 2026.05	77.6	-	-	-	-	70.2
SQL-o1 + Llama3-8B 2026.05	77.6	-	-	-	-	69.2
ROUTE + Llama3-8B 2026.05	77.4	-	-	-	-	70.2
MTIR-SQL 2026.06	77.2	-	-	-	-	-
Progress-SQL-14B 2026.06	77.1	-	-	-	-	69.1
SFT CodeS-15B 2026.05	77	-	-	-	-	69.4
OmniSQL-7B 2026.06	77	-	-	-	-	70.2
SFT CodeS-7B 2026.06	76.9	-	-	-	-	70
SQL-R1-7B* 2026.05	76.7	-	-	-	-	-
SQL-R1 2026.04	76.7	-	-	-	-	-
Progress-SQL-7B 2026.06	76.6	-	-	-	-	68.8
No-Train 2026.05	76.1	-	-	-	-	65
CYCLESQL + GPT-4 2026.05	76	-	-	-	-	66.3
Arctic-SQL + Qwen2.5-7B 2025.05	76	-	-	-	-	-
Reward-SQL + Qwen3-8B 2025.05	75.7	-	-	-	-	-
No-Train 2026.05	75.4	-	-	-	-	62
No-Train 2026.05	75.4	-	-	-	-	61.2
SQL-R1 + Qwen2.5-7B 2025.05	75.4	-	-	-	-	-
Arctic-SQL + Qwen2.5-7B 2025.05	75.2	-	-	-	-	-
Think2SQL-4B 2025.04	75	-	-	-	-	-
Think2SQL-8B 2025.04	74.9	-	-	-	-	-
KE-RL 2026.05	74.83	-	-	-	-	-
SQL-PaLM + PaLM2 2026.05	74.6	-	-	-	-	-
ASTRES 2025.05	74.4	61.3	-	-	-	-
FastRAText+GPT-4 2026.05	74.4	-	-	-	-	-
DCG-SQL 2025.05	74.2	61.6	-	-	-	-
OmniSQL + Qwen2.5-7B 2025.05	73.9	-	-	-	-	-
ACE-SQL 2026.06	73.7	-	-	-	-	-
SQL-R1-7B 2026.06	73.7	-	-	-	-	58
SkyRL-SQL-7B 2026.06	73.7	-	-	-	-	-
SQL-Trail-7B 2026.06	73.7	-	-	-	-	65.1
DCG-SQL 2025.05	73.6	62.6	-	-	-	-
ACT-SQL 2025.05	73.1	48.5	-	-	-	-
SQL-R1 + Qwen2.5-7B 2025.05	72.6	-	-	-	-	-
SENSE-7B 2026.04	72.6	-	-	-	-	-
MAC-SQL 2026.04	72.5	-	-	-	-	-
Qwen2.5-Coder-14B-Instruct 2026.06	72.3	-	-	-	-	65.6
OmniSQL-32B 2026.05	72.1	-	-	-	-	-
KE-ICL 2026.05	71.76	-	-	-	-	-
CodeS 2026.05	71.17	-	-	-	-	-
Qwen2.5-Coder-7B-Instruct 2026.06	70.9	-	-	-	-	62.3
OmniSQL + Qwen2.5-7B 2025.05	70.7	-	-	-	-	-
DCG-SQL 2025.05	70.5	59.9	-	-	-	-
ACT-SQL 2025.05	70.4	44.4	-	-	-	-
Qwen2.5-Coder-7B 2026.04	70.2	-	-	-	-	-
DCG-SQL 2025.05	70.1	59.7	-	-	-	-
OmniSQL-7B 2026.01	69.7	-	-	-	61.4	-
OmniSQL 2026.06	69.7	-	-	-	-	-
OmniSQL-7B 2026.04	69.6	-	-	-	-	-
DAIL-SQL 2026.05	69.5	-	-	-	-	-
Reasoning-SQL* 2026.05	69.3	-	-	-	-	-
Reasoning-SQL-7B 2026.06	69.3	-	-	-	-	-
Reasoning-SQL 2026.04	69.3	-	-	-	-	-
EVOLSQL-7B 2026.01	69.2	-	-	-	61.9	-
Omni 2026.05	69.17	-	-	-	-	-
ACT-SQL 2025.05	69.1	49.3	-	-	-	-
ASTRES 2025.05	68.7	49.5	-	-	-	-
ACT-SQL 2026.04	67.9	-	-	-	-	-
SQL-GEN 2026.05	67.8	-	-	-	-	-
KE-ICL 2026.05	66.98	-	-	-	-	-
ASTRES 2025.05	66.9	51.2	-	-	-	-
Qwen2.5-Coder-7B-Instruct 2025.05	66.9	-	-	-	-	-
ACT-SQL 2025.05	66.6	53.7	-	-	-	-
KE-ICL 2026.05	66.05	-	-	-	-	-
KE-RL 2026.05	66.04	-	-	-	-	-
SFT (BIRD+Spider) 2026.01	65.9	-	-	-	55.8	-
CodeS 2026.05	65.86	-	-	-	-	-
DAIL-SQL 2026.05	65.43	-	-	-	-	-
DIN-SQL 2025.05	65.3	34.7	-	-	-	-
DeepSeek-V3 (671B MoE) 2025.05	65.1	-	-	-	-	-
CodeS 2026.05	64.77	-	-	-	-	-
DeepSeek-V3 (671B MoE) 2025.05	64.4	-	-	-	-	-
Qwen2.5-72B-Instruct 2025.05	64.3	-	-	-	-	-
Qwen2.5-72B-Instruct 2025.05	64.1	-	-	-	-	-
KE-ICL 2026.05	64	-	-	-	-	-
GPT-4-Turbo 2025.05	63.5	-	-	-	-	-
DAIL-SQL 2026.05	63.44	-	-	-	-	-
ACT-SQL 2025.05	63.2	44.6	-	-	-	-
Base Model 2026.01	63.1	-	-	-	53.4	-
Qwen2.5-Coder-7B-Instruct 2025.05	63.1	-	-	-	-	-

Showing 100 of 187 rows