Context-Dependent Fine-Grained Entity Type Tagging
About
Entity type tagging is the task of assigning category labels to each mention of an entity in a document. While standard systems focus on a small set of types, recent work (Ling and Weld, 2012) suggests that using a large fine-grained label set can lead to dramatic improvements in downstream tasks. In the absence of labeled training data, existing fine-grained tagging systems obtain examples automatically, using resolved entities and their types extracted from a knowledge base. However, since the appropriate type often depends on context (e.g. Washington could be tagged either as city or government), this procedure can result in spurious labels, leading to poorer generalization. We propose the task of context-dependent fine type tagging, where the set of acceptable labels for a mention is restricted to only those deducible from the local context (e.g. sentence or document). We introduce new resources for this task: 12,017 mentions annotated with their context-dependent fine types, and we provide baseline experimental results on this data.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Fine-Grained Entity Typing | OntoNotes (test) | Macro F1 Score72.5 | 27 | |
| Fine-Grained Entity Typing | Wiki (test) | Accuracy37.3 | 11 | |
| Label Noise Reduction | BBN | Accuracy51.6 | 11 | |
| Entity recognition and typing | Wiki-KBP (test) | S-F10.3 | 7 | |
| Entity recognition and typing | BioInfer (test) | Strict F1 Score69 | 7 | |
| Entity recognition and typing | NYT (test) | S-F138 | 7 |