Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL

About

The open-domain text-to-SQL task aims to retrieve question-relevant tables from massive databases and generate SQL. However, the performance of current methods is constrained by single-hop retrieval, and existing multi-hop retrieval of open-domain question answering is not directly applicable due to the tendency to retrieve tables similar to the retrieved ones but irrelevant to the question. Since the questions in text-to-SQL usually contain all required information, while previous multi-hop retrieval supplements the questions with retrieved documents. Therefore, we propose the multi-hop table retrieval with removal (MURRE), which removes previously retrieved information from the question to guide the retriever towards unretrieved relevant tables. Our experiments on two open-domain text-to-SQL datasets demonstrate an average improvement of 5.7% over the previous state-of-the-art results.

Xuanliang Zhang, Dingzirui Wang, Longxu Dou, Qingfu Zhu, Wanxiang Che• 2024

Related benchmarks

TaskDatasetResultRank
Text-to-SQLSpider (test)--
213
Text-to-SQLSpider
Exec Acc (All)70.5
139
Text-to-SQLBIRD (test)--
46
Text-to-SQLSpider 2.0 (test)
Execution Accuracy (Spider 2.0 Test)7.4
27
Text-to-SQLBird
Execution Accuracy (Llama-8B)25.3
21
Text-to-SQLSpider 2.0
Llama-8B Execution Accuracy0.9
21
Table RetrievalSpider Lite 2.0 (test)
Precision28.1
20
Table RetrievalSpider union (test)
Precision (P)40.5
20
Table RetrievalBIRD union (test)
Precision44.6
20
Showing 9 of 9 rows

Other info

Follow for update