Share your thoughts, 1 month free Claude Pro on usSee more

NL-to-SQL on WikiTQ

59.7Execution Accuracy

Table-Specialist

Updated 6d ago

Evaluation Results

Method	Links
Table-Specialist 2024.10		59.7
GPT-4 2024.10		55.9
Table-Specialist 2024.10		51.3
Table-Specialist 2024.10		44.9
GPT-3.5 2024.10		42.1
Llama3.1-8B 2024.10		30
Table-Specialist 2024.10		0.55
Reflection 2026.05		0.49
Reflection 2026.05		0.449
GPT-4 2024.10		0.416
No Memory 2026.05		0.408
Table-Specialist 2024.10		0.404
No Memory 2026.05		0.388
LiTS-Fact 2026.05		0.388
Raw Sibling 2026.05		0.367
LiTS-Fact 2026.05		0.347
Raw Sibling 2026.05		0.306
ReAct 2026.05		0.286
No Memory 2026.05		0.265
Table-Specialist 2024.10		0.257
GPT-3.5 2024.10		0.209
Llama3.1-8B 2024.10		0.138