Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TACRED

Benchmarks

Task NameDataset NameSOTA ResultTrend
Relation ExtractionTACRED (test)
F1 Score75.5
194
Relation ExtractionTACRED
Micro F186.6
97
Relation ExtractionTACRED v1.0 (test)
F1 Score91.1
37
Relation ExtractionRe-TACRED
Micro F165.15
35
Relation ExtractionTACRED-Revisit
Micro F137.26
35
Relation ExtractionTACREV (test)
F1 Score88.3
27
Relation ExtractionTACRED Original (test)
F1 Score74.6
23
Relation ExtractionTACRED-Revisit (test)
Micro F182.4
19
Relation ExtractionTACRED v1.0 (5% train)
Micro F10.69
19
Relation ExtractionTACRED v1.0 (full)
Micro F175.1
16
Relation ClassificationTACRED
F1 Score76.8
14
Relation ExtractionTACRED few-shot zero-shot
F1 Score40.7
13
Relation ExtractionTACRED v1.0 (10% train)
Micro F170.7
13
Relation ExtractionTACRED 1% v1.0 (train)
Micro F163.7
13
Relation ExtractionTACRED One-shot
Precision32.45
12
OOD DetectionTACRED
AUROC0.89
12
Open-set selective classificationTACRED (test)
AUAC96.2
12
Relation ExtractionTACRED Relabeled (test)
F1 Score83.1
12
Relation ExtractionTACRED Relabeled (dev)
F1 Score0.819
12
Relation ExtractionTACRED Original (dev)
F1 Score73.1
12
Relation ClassificationTACRED original (test)
Micro F175.3
11
Relation ClassificationTACRED K=32 original (low-resource)
Micro F137.4
11
Relation ClassificationTACRED K=16 original (low-resource)
Micro F136.6
11
Relation ClassificationTACRED K=8 low-resource original
Micro F10.357
11
Relation Extractionrevised TACRED (test)
Micro-F184.1
11
Showing 25 of 47 rows