Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis

About

Training effective Text-to-SQL models remains challenging due to the scarcity of high-quality, diverse, and structurally complex datasets. Existing methods either rely on limited human-annotated corpora, or synthesize datasets directly by simply prompting LLMs without explicit control over SQL structures, often resulting in limited structural diversity and complexity. To address this, we introduce EvolSQL, a structure-aware data synthesis framework that evolves SQL queries from seed data into richer and more semantically diverse forms. EvolSQL starts with an exploratory Query-SQL expansion to broaden question diversity and improve schema coverage, and then applies an adaptive directional evolution strategy using six atomic transformation operators derived from the SQL Abstract Syntax Tree to progressively increase query complexity across relational, predicate, aggregation, and nesting dimensions. An execution-grounded SQL refinement module and schema-aware deduplication further ensure the creation of high-quality, structurally diverse mapping pairs. Experimental results show that a 7B model fine-tuned on our data outperforms one trained on the much larger SynSQL dataset using only 1/18 of the data.

Xuanguang Pan, Chongyang Tao, Jiayuan Bai, Jianling Gao, Zhengwei Tao, Xiansheng Zhou, Gavin Cheung, Shuai Ma• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-SQLBIRD (dev)
Execution Accuracy (EA)65.1
217
Text-to-SQLSpider (test)
Execution Accuracy86.1
140
Text-to-SQLSpider (dev)
EX (All)86.1
100
Text-to-SQLSpider-Realistic
Execution Accuracy (EX)75.8
33
Text-to-SQLSpider-DK
Execution Accuracy (EX)74.2
26
Text-to-SQLSpider-Syn
Execution Accuracy (EX)69.2
26
Text-to-SQLEHRSQL
Execution Accuracy38.6
9
Text-to-SQLScience Benchmark
Execution Accuracy51.8
4
Showing 8 of 8 rows

Other info

Follow for update