Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling

About

Recent BIO-tagging-based neural semantic role labeling models are very high performing, but assume gold predicates as part of the input and cannot incorporate span-level features. We propose an end-to-end approach for jointly predicting all predicates, arguments spans, and the relations between them. The model makes independent decisions about what relationship, if any, holds between every possible word-span pair, and learns contextualized span representations that provide rich, shared input features for each decision. Experiments demonstrate that this approach sets a new state of the art on PropBank SRL without gold predicates.

Luheng He, Kenton Lee, Omer Levy, Luke Zettlemoyer• 2018

Related benchmarks

TaskDatasetResultRank
Semantic Role LabelingCoNLL 2012 (test)
F1 Score85.5
49
Span-based Semantic Role LabelingCoNLL 2005 (Out-of-domain (Brown))
F1 Score80.4
41
Semantic Role LabelingCoNLL 2005 (WSJ)
F1 Score87.4
41
Semantic Role LabelingCoNLL Brown 2005 (test)
F180.4
40
Semantic Role LabelingCoNLL 2005 (Brown)
F1 Score80.4
31
Semantic Role LabelingCoNLL WSJ 2005 (test)
Precision84.8
29
Span Semantic Role LabelingCoNLL-2012 (OntoNotes) v5.0 (test)
F1 Score85.5
25
Semantic Role LabelingCoNLL 2005 (WSJ (in-domain))
F1 Score87.4
24
Semantic Role LabelingCoNLL 2012 (dev)
F183
23
Semantic Role LabelingCoNLL 2005 (dev)
F1 Score85.3
22
Showing 10 of 23 rows

Other info

Code

Follow for update