Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

A Full End-to-End Semantic Role Labeler, Syntax-agnostic Over Syntax-aware?

About

Semantic role labeling (SRL) is to recognize the predicate-argument structure of a sentence, including subtasks of predicate disambiguation and argument labeling. Previous studies usually formulate the entire SRL problem into two or more subtasks. For the first time, this paper introduces an end-to-end neural model which unifiedly tackles the predicate disambiguation and the argument labeling in one shot. Using a biaffine scorer, our model directly predicts all semantic role labels for all given word pairs in the sentence without relying on any syntactic parse information. Specifically, we augment the BiLSTM encoder with a non-linear transformation to further distinguish the predicate and the argument in a given sentence, and model the semantic role labeling process as a word pair classification task by employing the biaffine attentional mechanism. Though the proposed model is syntax-agnostic with local decoder, it outperforms the state-of-the-art syntax-aware SRL systems on the CoNLL-2008, 2009 benchmarks for both English and Chinese. To our best knowledge, we report the first syntax-agnostic SRL model that surpasses all known syntax-aware models.

Jiaxun Cai, Shexia He, Zuchao Li, Hai Zhao• 2018

Related benchmarks

TaskDatasetResultRank
Dependency Semantic Role LabelingCoNLL 2009 (test)
F1 Score89.6
32
Semantic Role LabelingCoNLL WSJ English benchmark 2009 (test)
F1 Score89.6
31
Semantic Role LabelingCoNLL English Brown 2009 (test)
F1 Score79
28
Dependency-based Semantic Role LabelingCoNLL Brown 2009 (test)
Precision79.8
22
Argument identification and classificationCoNLL 2009 (test)
F1 Score90
12
Argument Recognition and Role LabelingCoNLL English in-domain 2009 (test)
Precision89.7
10
Predicate DetectionCoNLL English in-domain 2009 (test)
F1 Score94.9
10
Dependency Semantic Role LabelingCoNLL WSJ 2008
F1 Score85
6
End-to-end Semantic Role LabelingUniversal Proposition Bank (UPB) (test)
DE SRL Score69.9
5
Argument Semantic Role LabelingCoNLL out-of-domain 2009 (test)
Precision80.4
4
Showing 10 of 12 rows

Other info

Follow for update