Coarse-to-Fine Decoding for Neural Semantic Parsing
About
Semantic parsing aims at mapping natural language utterances into structured meaning representations. In this work, we propose a structure-aware neural architecture which decomposes the semantic parsing process into two stages. Given an input utterance, we first generate a rough sketch of its meaning, where low-level information (such as variable names and arguments) is glossed over. Then, we fill in missing details by taking into account the natural language input and the sketch itself. Experimental results on four datasets characteristic of different domains and meaning representations show that our approach consistently improves performance, achieving competitive results despite the use of relatively simple decoders.
Li Dong, Mirella Lapata• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Code Generation | Django (test) | Accuracy83 | 28 | |
| Semantic Parsing | WikiSQL (test) | Execution Accuracy79.6 | 27 | |
| Semantic Parsing | GEO | Accuracy0.939 | 26 | |
| Semantic Parsing | ATIS | Accuracy95.1 | 19 | |
| Natural Language to SQL | WikiSQL (test) | Accuracy78.5 | 17 | |
| Semantic Parsing | Geoquery (test) | Accuracy88.2 | 14 | |
| Semantic Parsing | WikiSQL (dev) | Accuracy79 | 13 | |
| SQL Query Generation | WikiSQL (dev) | Accuracy79 | 13 | |
| Text-to-SQL | WikiSQL Fully-supervised (dev) | Execution Accuracy79 | 12 | |
| Text-to-SQL | WikiSQL Fully-supervised (test) | Execution Accuracy78.5 | 12 |
Showing 10 of 12 rows