Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Bootstrapping Semantic Layer from Execution for Text-to-SQL

About

Real-world text-to-SQL is often under-specified until user phrases are grounded in how the database stores values. Prior work attempts to address this by requiring a semantic layer to specify groundings in advance, but such specifications are often incomplete, especially in expert domains where domain-specific conventions are under-documented. As this leaves multiple grounding hypotheses open for the same SQL part, we introduce GATE (Grouding After Test from Execution), which bootstraps missing groundings from execution feedback. GATE keeps grounding hypotheses open while executing the already grounded parts to obtain observations. Then, only the hypothesis supported by that observation is grounded and stored as a memory entry, recording what was tested and how the open part should be written in SQL. These entries accumulate into execution-grounded memory, allowing later steps to reuse supported groundings. Across real-world and controlled benchmarks, GATE consistently improves over strong baselines, demonstrating that execution can serve not only as validation but also as a bootstrapping mechanism for reusable memory in text-to-SQL.

Youngwon Lee, Jaejin Kim, Seung-won Hwang• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-SQLEHRSQL
Execution Accuracy35
69
Database Question AnsweringRealEHR (test)
Accuracy55.2
8
Database Question AnsweringEHRSQL (test)
Execution Accuracy35
8
Database Question AnsweringLS-Hard (test)
Answer Accuracy45.1
8
Question AnsweringRealEHR
Accuracy55.2
8
Question AnsweringLS-Hard
Accuracy45.1
8
Showing 6 of 6 rows

Other info

Follow for update