Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SUBS: Subtree Substitution for Compositional Semantic Parsing

About

Although sequence-to-sequence models often achieve good performance in semantic parsing for i.i.d. data, their performance is still inferior in compositional generalization. Several data augmentation methods have been proposed to alleviate this problem. However, prior work only leveraged superficial grammar or rules for data augmentation, which resulted in limited improvement. We propose to use subtree substitution for compositional data augmentation, where we consider subtrees with similar semantic functions as exchangeable. Our experiments showed that such augmented data led to significantly better performance on SCAN and GeoQuery, and reached new SOTA on compositional split of GeoQuery.

Jingfeng Yang, Le Zhang, Diyi Yang• 2022

Related benchmarks

TaskDatasetResultRank
Semantic ParsingGeoQuery (i.i.d.)
Exact Match Accuracy91.8
32
Semantic ParsingGeoQuery compositional
Accuracy88.3
29
Showing 2 of 2 rows

Other info

Follow for update