ACE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Nested Named Entity Recognition | ACE 2004 (test) | F1 Score89.7 | 166 | |
| Nested Named Entity Recognition | ACE 2005 (test) | F1 Score90 | 153 | |
| Relation Extraction | ACE05 (test) | F1 Score73 | 72 | |
| Argument Classification | ACE05-E (test) | F1 Score74.2 | 63 | |
| Named Entity Recognition | ACE 2005 (test) | F1 Score89.9 | 58 | |
| Entity Extraction | ACE05 (test) | F1 Score91.1 | 53 | |
| Nested Named Entity Recognition | ACE 2005 | F1 Score86.9 | 52 | |
| Argument Identification and Classification | ACE05-E (test) | Arg-I Score76.7 | 48 | |
| Argument Identification and Classification | ACE05-E (dev) | Arg-I Score80.9 | 48 | |
| Argument Classification | ACE05-E (dev) | F1 Score76.6 | 48 | |
| Named Entity Recognition | ACE05 | F1 Score89.1 | 41 | |
| Named Entity Recognition | ACE04 (test) | F1 Score88.72 | 36 | |
| Nested Named Entity Recognition | ACE 2004 | F1 Score (%)86.84 | 32 | |
| Named Entity Recognition | ACE 2005 | Entity F190.9 | 30 | |
| Nested Mention Detection | ACE2005 (test) | F1 Score84.33 | 30 | |
| Event Detection | ACE 2005 | F1 Score74.7 | 27 | |
| Entity Linking | ACE2004 (test) | Micro F1 Score93.1 | 27 | |
| Event Extraction | ACE05 Evt | Event Trigger F174.08 | 26 | |
| Sequence Labeling | ACE05 (test) | Micro F177.79 | 23 | |
| Event Detection | ACE05-E+ (Evaluation) | F1 Score74.9 | 23 | |
| Relation Extraction | ACE bc 2005 (test) | Precision74.39 | 22 | |
| Event Argument Extraction | ACE 2005 | F1 Score75.2 | 21 | |
| Relation Extraction | ACE04 (test) | F1 Score69.7 | 21 | |
| Event Argument Extraction | ACE05-E (test) | Arg-C Score72.8 | 20 | |
| Entity Disambiguation | ACE 2004 (test) | Micro F191.9 | 20 |
Showing 25 of 93 rows