Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Disambiguate First, Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsing

About

Handling ambiguity and underspecification is an important challenge in natural language interfaces, particularly for tasks like text-to-SQL semantic parsing. We propose a modular approach that resolves ambiguity using natural language interpretations before mapping these to logical forms (e.g., SQL queries). Although LLMs excel at parsing unambiguous utterances, they show strong biases for ambiguous ones, typically predicting only preferred interpretations. We constructively exploit this bias to generate an initial set of preferred disambiguations and then apply a specialized infilling model to identify and generate missing interpretations. To train the infilling model, we introduce an annotation method that uses SQL execution to validate different meanings. Our approach improves interpretation coverage and generalizes across datasets with different annotation styles, database structures, and ambiguity types.

Irina Saparina, Mirella Lapata• 2025

Related benchmarks

TaskDatasetResultRank
Text-to-SQLAmbiQT in-domain
Single Interpretation Coverage92.3
7
Text-to-SQLAmbrosia (out-of-domain)
Single Interpretation Coverage84.4
7
Text-to-SQL ambiguity resolutionAmbrosia Ambiguous
Recall59.7
2
Text-to-SQL ambiguity resolutionAmbiQT
Recall58.5
2
Showing 4 of 4 rows

Other info

Code

Follow for update