Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-SQL on BIRD (Accuracy)

69.1Accuracy

Agentic SQL + CSMR + ATR

Updated 24d ago

Evaluation Results

Method	Links
Agentic SQL + CSMR + ATR 2026.03		69.1
Arctic-Text2SQL-R1-7B 2026.03		67.6
Single-Turn GRPO 2026.03		67.4
SQL-R1 + OmniSQL-7B 2026.03		66.6
GPT-4o 2026.03		64.4
Agentic SQL + CSMR + ATR 2026.03		64.2
ATR 2026.03		64.2
OmniSQL-7B 2026.03		64.1
Reasoning-SQL-7B 2026.03		64
Agentic SQL + ATR 2026.03		63.6
SQL-R1 + Qwen2.5-Coder-7B 2026.03		63.1
MTIR-SQL-4B 2026.03		63.1
Deepseek-V3 2026.03		62.5
Agentic SQL + CSMR 2026.03		62.5
ATR w/ Step-wise Update 2026.03		61.3
Agentic SQL 2026.03		61.1
ATR w/ Symmetric Matrix 2026.03		60.1
Single-Turn GRPO + CSMR 2026.03		59.4
Single-Turn GRPO 2026.03		58.5
Qwen2.5-Coder-7B 2026.03		58.2
Qwen2.5-7B-Instruct 2026.03		47.5
Table-Specialist 2024.10		47.5
GPT-4 2024.10		43
Table-Specialist 2024.10		40.4
GPT-3.5 2024.10		31.7
Table-Specialist 2024.10		26.1
Llama3.1-8B 2024.10		22.5