Simpler but More Accurate Semantic Dependency Parsing
About
While syntactic dependency annotations concentrate on the surface or functional structure of a sentence, semantic dependency annotations aim to capture between-word relationships that are more closely related to the meaning of a sentence, using graph-structured representations. We extend the LSTM-based syntactic parser of Dozat and Manning (2017) to train on and generate these graph structures. The resulting system on its own achieves state-of-the-art performance, beating the previous, substantially more complex state-of-the-art system by 0.6% labeled F1. Adding linguistically richer input representations pushes the margin even higher, allowing us to beat it by 1.9% labeled F1.
Timothy Dozat, Christopher D. Manning• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Dependency Parsing | SemEval Task 18 2015 (WSJ ID) | Avg (LF1)93.7 | 17 | |
| Semantic Dependency Parsing | SemEval Task 18 Brown corpus OOD 2015 | Average LF188.9 | 17 | |
| Semantic Dependency Parsing | SemEval SDP DM OOD 2015 | F1 Score88.9 | 7 | |
| Semantic Dependency Parsing | SemEval SDP PAS OOD 2015 | F1 (PAS)90.6 | 6 | |
| Semantic Dependency Parsing | SemEval SDP PSD 2015 (ID) | F1 Score81 | 6 | |
| Semantic Dependency Parsing | SemEval SDP PSD OOD 2015 | F1 Score79.4 | 6 |
Showing 6 of 6 rows