Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation

About

Interacting with relational databases through natural language helps users of any background easily query and analyze a vast amount of data. This requires a system that understands users' questions and converts them to SQL queries automatically. In this paper we present a novel approach, TypeSQL, which views this problem as a slot filling task. Additionally, TypeSQL utilizes type information to better understand rare entities and numbers in natural language questions. We test this idea on the WikiSQL dataset and outperform the prior state-of-the-art by 5.5% in much less time. We also show that accessing the content of databases can significantly improve the performance when users' queries are not well-formed. TypeSQL gets 82.6% accuracy, a 17.5% absolute improvement compared to the previous content-sensitive model.

Tao Yu, Zifan Li, Zilin Zhang, Rui Zhang, Dragomir Radev• 2018

Related benchmarks

TaskDatasetResultRank
Text-to-SQLSpider 1.0 (dev)
Exact Match Accuracy8
92
Text-to-SQLSpider 1.0 (test)
EM Acc (Overall)8.2
91
Semantic ParsingWikiSQL (test)
Execution Accuracy82.6
27
Natural Language to SQLWikiSQL (test)
Accuracy73.5
17
Semantic ParsingWikiSQL (dev)
Accuracy74.5
13
SQL Query GenerationWikiSQL (dev)
Accuracy74.5
13
Text-to-SQL (Component Matching)Spider (test)
SELECT Component Error36.4
9
Text-to-SQLWikiSQL 1.0 (dev)
Execution Accuracy0.855
8
Text-to-SQLWikiSQL 1.0 (test)
Execution Accuracy82.6
8
Showing 9 of 9 rows

Other info

Code

Follow for update