Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

C3: Zero-shot Text-to-SQL with ChatGPT

About

This paper proposes a ChatGPT-based zero-shot Text-to-SQL method, dubbed C3, which achieves 82.3\% in terms of execution accuracy on the holdout test set of Spider and becomes the state-of-the-art zero-shot Text-to-SQL method on the Spider Challenge. C3 consists of three key components: Clear Prompting (CP), Calibration with Hints (CH), and Consistent Output (CO), which are corresponding to the model input, model bias and model output respectively. It provides a systematic treatment for zero-shot Text-to-SQL. Extensive experiments have been conducted to verify the effectiveness and efficiency of our proposed method.

Xuemei Dong, Chao Zhang, Yuhang Ge, Yuren Mao, Yunjun Gao, lu Chen, Jinshu Lin, Dongfang Lou• 2023

Related benchmarks

TaskDatasetResultRank
Text-to-SQLSpider (test)
Execution Accuracy82.3
140
Text-to-SQLSpider 1.0 (dev)
Exact Match Accuracy81.8
92
Text-to-SQLSpider 1.0 (test)
EM Acc (Overall)82.3
91
Showing 3 of 3 rows

Other info

Code

Follow for update