Neural Semantic Role Labeling with Dependency Path Embeddings
About
This paper introduces a novel model for semantic role labeling that makes use of neural sequence modeling techniques. Our approach is motivated by the observation that complex syntactic structures and related phenomena, such as nested subordinations and nominal predicates, are not handled well by existing models. Our model treats such instances as sub-sequences of lexicalized dependency paths and learns suitable embedding representations. We experimentally demonstrate that such embeddings can improve results over previous state-of-the-art semantic role labelers, and showcase qualitative improvements obtained by our method.
Michael Roth, Mirella Lapata• 2016
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Dependency Semantic Role Labeling | CoNLL 2009 (test) | F1 Score87.7 | 32 | |
| Semantic Role Labeling | CoNLL WSJ English benchmark 2009 (test) | F1 Score87.9 | 31 | |
| Semantic Role Labeling | CoNLL English Brown 2009 (test) | F1 Score76.5 | 28 | |
| Dependency-based Semantic Role Labeling | CoNLL 2009 (Out-of-domain (Brown)) | F1 Score76.5 | 17 | |
| Argument identification and classification | CoNLL 2009 (test) | F1 Score86.7 | 12 | |
| Predicate disambiguation | CoNLL 2009 (dev) | Accuracy94.8 | 9 | |
| Dependency-based Semantic Role Labeling | CoNLL In-domain 2009 | Precision90.3 | 7 | |
| Predicate disambiguation | CoNLL 2009 (WSJ) | Accuracy95.5 | 7 | |
| Predicate disambiguation | CoNLL 2009 (test) | Accuracy95.47 | 4 | |
| Semantic Role Labeling | CoNLL shared-task 2009 (test) | Precision76.9 | 4 |
Showing 10 of 10 rows