Language to Logical Form with Neural Attention
About
Semantic parsing aims at mapping natural language to machine interpretable meaning representations. Traditional approaches rely on high-quality lexicons, manually-built templates, and linguistic features which are either domain- or representation-specific. In this paper we present a general method based on an attention-enhanced encoder-decoder model. We encode input utterances into vector representations, and generate their logical forms by conditioning the output sequences or trees on the encoding vectors. Experimental results on four datasets show that our approach performs competitively without using hand-engineered features and is easy to adapt across domains and meaning representations.
Li Dong, Mirella Lapata• 2016
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Text-to-SQL | Spider 1.0 (dev) | Exact Match Accuracy1.9 | 92 | |
| Text-to-SQL | Spider 1.0 (test) | EM Acc (Overall)4.8 | 91 | |
| Semantic Parsing | CFQ (MCD1) | Accuracy24.3 | 33 | |
| Semantic Parsing | CFQ (MCD2) | Accuracy4.1 | 33 | |
| Semantic Parsing | CFQ MCD3 | Accuracy6.3 | 33 | |
| Code Generation | Django (test) | Accuracy39.4 | 28 | |
| Semantic Parsing | WikiSQL (test) | Execution Accuracy35.9 | 27 | |
| Semantic Parsing | GEO | Accuracy0.871 | 26 | |
| Semantic Parsing | ATIS | Accuracy84.8 | 19 | |
| Semantic Parsing | WikiTableQuestions (test) | -- | 17 |
Showing 10 of 19 rows