Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Abstract Syntax Networks for Code Generation and Semantic Parsing

About

Tasks like code generation and semantic parsing require mapping unstructured (or partially structured) inputs to well-formed, executable outputs. We introduce abstract syntax networks, a modeling framework for these problems. The outputs are represented as abstract syntax trees (ASTs) and constructed by a decoder with a dynamically-determined modular structure paralleling the structure of the output tree. On the benchmark Hearthstone dataset for code generation, our model obtains 79.2 BLEU and 22.7% exact match accuracy, compared to previous state-of-the-art values of 67.1 and 6.1%. Furthermore, we perform competitively on the Atis, Jobs, and Geo semantic parsing datasets with no task-specific engineering.

Maxim Rabinovich, Mitchell Stern, Dan Klein• 2017

Related benchmarks

TaskDatasetResultRank
Semantic ParsingGEO
Accuracy0.871
26
Semantic ParsingATIS
Accuracy85.9
19
Semantic ParsingATIS (test)
Accuracy85.9
8
Semantic ParsingGEO (test)
Accuracy87.1
8
Semantic ParsingJOBS
Accuracy92.9
6
Semantic ParsingHEARTHSTONE (test)
Accuracy22.7
4
Showing 6 of 6 rows

Other info

Code

Follow for update