Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ACE

Benchmarks

Task NameDataset NameSOTA ResultTrend
Nested Named Entity RecognitionACE 2004 (test)
F1 Score89.7
166
Nested Named Entity RecognitionACE 2005 (test)
F1 Score90
153
Relation ExtractionACE05 (test)
F1 Score73
72
Argument ClassificationACE05-E (test)
F1 Score74.2
63
Named Entity RecognitionACE 2005 (test)
F1 Score89.9
58
Entity ExtractionACE05 (test)
F1 Score91.1
53
Nested Named Entity RecognitionACE 2005
F1 Score86.9
52
Argument Identification and ClassificationACE05-E (test)
Arg-I Score76.7
48
Argument Identification and ClassificationACE05-E (dev)
Arg-I Score80.9
48
Argument ClassificationACE05-E (dev)
F1 Score76.6
48
Named Entity RecognitionACE05
F1 Score89.1
38
Named Entity RecognitionACE04 (test)
F1 Score88.72
36
Nested Named Entity RecognitionACE 2004
F1 Score (%)86.84
32
Nested Mention DetectionACE2005 (test)
F1 Score84.33
30
Event DetectionACE 2005
F1 Score74.7
27
Entity LinkingACE2004 (test)
Micro F1 Score93.1
27
Event ExtractionACE05 Evt
Event Trigger F174.08
26
Sequence LabelingACE05 (test)
Micro F177.79
23
Event DetectionACE05-E+ (Evaluation)
F1 Score74.9
23
Named Entity RecognitionACE 2005
Entity F190.9
22
Relation ExtractionACE bc 2005 (test)
Precision74.39
22
Relation ExtractionACE04 (test)
F1 Score69.7
21
Event Argument ExtractionACE05-E (test)
Arg-C Score72.8
20
Entity DisambiguationACE 2004 (test)
Micro F191.9
20
Entity ExtractionACE04 (test)
F1 Score90.4
19
Showing 25 of 90 rows