Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling
About
Recent BIO-tagging-based neural semantic role labeling models are very high performing, but assume gold predicates as part of the input and cannot incorporate span-level features. We propose an end-to-end approach for jointly predicting all predicates, arguments spans, and the relations between them. The model makes independent decisions about what relationship, if any, holds between every possible word-span pair, and learns contextualized span representations that provide rich, shared input features for each decision. Experiments demonstrate that this approach sets a new state of the art on PropBank SRL without gold predicates.
Luheng He, Kenton Lee, Omer Levy, Luke Zettlemoyer• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Role Labeling | CoNLL 2012 (test) | F1 Score85.5 | 49 | |
| Span-based Semantic Role Labeling | CoNLL 2005 (Out-of-domain (Brown)) | F1 Score80.4 | 41 | |
| Semantic Role Labeling | CoNLL 2005 (WSJ) | F1 Score87.4 | 41 | |
| Semantic Role Labeling | CoNLL Brown 2005 (test) | F180.4 | 40 | |
| Semantic Role Labeling | CoNLL 2005 (Brown) | F1 Score80.4 | 31 | |
| Semantic Role Labeling | CoNLL WSJ 2005 (test) | Precision84.8 | 29 | |
| Span Semantic Role Labeling | CoNLL-2012 (OntoNotes) v5.0 (test) | F1 Score85.5 | 25 | |
| Semantic Role Labeling | CoNLL 2005 (WSJ (in-domain)) | F1 Score87.4 | 24 | |
| Semantic Role Labeling | CoNLL 2012 (dev) | F183 | 23 | |
| Semantic Role Labeling | CoNLL 2005 (dev) | F1 Score85.3 | 22 |
Showing 10 of 23 rows