REL: An Entity Linker Standing on the Shoulders of Giants
About
Entity linking is a standard component in modern retrieval system that is often performed by third-party toolkits. Despite the plethora of open source options, it is difficult to find a single system that has a modular architecture where certain components may be replaced, does not depend on external sources, can easily be updated to newer Wikipedia versions, and, most important of all, has state-of-the-art performance. The REL system presented in this paper aims to fill that gap. Building on state-of-the-art neural components from natural language processing research, it is provided as a Python package as well as a web API. We also report on an experimental comparison against both well-established systems and the current state-of-the-art on standard entity linking benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Entity Linking | MSNBC | Micro F188.5 | 36 | |
| Entity Linking | OKE 2016 | Macro F172 | 31 | |
| Entity Linking | AIDA B | Macro F10.813 | 30 | |
| Entity Linking | AIDA (testb) | Micro F182.4 | 28 | |
| Entity Linking | KORE50 | Macro F161.9 | 27 | |
| Entity Linking | OKE 2015 | Macro F165.5 | 26 | |
| Entity Linking | N3-Reuters-128 | Macro F159.8 | 25 | |
| Entity Linking | N3-RSS-500 | Macro F161.7 | 25 | |
| Entity Linking | Derczynski | Macro F162.3 | 25 | |
| Entity Linking | AIDA (testa) | Micro F183.3 | 23 |