Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks
About
Entity and Relation Extraction (ERE) is an important task in information extraction. Recent marker-based pipeline models achieve state-of-the-art performance, but still suffer from the error propagation issue. Also, most of current ERE models do not take into account higher-order interactions between multiple entities and relations, while higher-order modeling could be beneficial.In this work, we propose HyperGraph neural network for ERE ($\hgnn{}$), which is built upon the PL-marker (a state-of-the-art marker-based pipleline model). To alleviate error propagation,we use a high-recall pruner mechanism to transfer the burden of entity identification and labeling from the NER module to the joint module of our model. For higher-order modeling, we build a hypergraph, where nodes are entities (provided by the span pruner) and relations thereof, and hyperedges encode interactions between two different relations or between a relation and its associated subject and object entities. We then run a hypergraph neural network for higher-order inference by applying message passing over the built hypergraph. Experiments on three widely used benchmarks (\acef{}, \ace{} and \scierc{}) for ERE task show significant improvements over the previous state-of-the-art PL-marker.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Relation Extraction | SciERC | Relation Strict F143.86 | 48 | |
| Named Entity Recognition | Sci-ERC | F1 Score81.19 | 23 | |
| Relation Extraction | BioRED | Overall Rel+ F132.39 | 15 | |
| Relation Extraction | SemEval 2017 | Hierarchical F133.81 | 15 | |
| Relation Extraction | SciER | Hierarchical Relation F143.79 | 15 | |
| Named Entity Recognition | Sphere | CS NER Score69.82 | 12 | |
| Named Entity Recognition | BioRED | F1 Score (%)89.43 | 10 | |
| Named Entity Recognition | SemEval | F1 Score (%)48.25 | 10 | |
| Joint Entity and Relation Extraction | SCIERC (test) | GFLOPs22.5 | 7 | |
| Relation Extraction | SPHERE Computer Science | Rel+ F1 (Hierarchical)54.2 | 5 |