Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DocRED

Benchmarks

Task NameDataset NameSOTA ResultTrend
Document-level Relation ExtractionDocRED (dev)
F1 Score63.18
231
Document-level Relation ExtractionDocRED (test)
F1 Score64.03
179
Relation ExtractionDocRED (test)
F1 Score65.92
121
Relation ExtractionDocRED (dev)
F1 Score65.69
98
Relation ExtractionDocRED v1 (test)
F167.28
66
Relation ExtractionDocRED v1 (dev)
F1 Score67.12
65
Relation ExtractionRe-DocRED (test)
Ignored F183.11
56
Document-level Relation ExtractionDocRED 1.0 (test)
F163.89
51
Relation ExtractionDocRED official (test)
RE67.53
45
Document-level Relation ExtractionDocRED 1.0 (dev)
F162.24
42
Document-level Relation ExtractionRe-DocRED (test)
Ignored F1 Score80.39
38
Relation ExtractionDocRED official (dev)
F1 Score67.41
38
Relation ExtractionDocRED human-annotated (test)
Micro F159.5
36
Document-level Relation ExtractionDocRED Long-Tail Triples (dev)
Precision0.4387
16
Evidence RetrievalDocRED (dev)
F1 Score57.55
14
Evidence RetrievalDocRED (test)
F1 Score57.34
13
Document-level Relation ExtractionEnv-Re-DocRED revised entity name variation (test)
Ignored F168.87
12
Coreference ResolutionDocRED official (test)
COREF84.96
7
Relation ExtractionDocRED (val)
Ignored F159.58
6
Mention ExtractionDocRED official (test)
ME Score93.38
6
Evidence RetrievalDocRED v1 (test)
F1 Score55.67
6
Evidence RetrievalDocRED v1 (dev)
F1 Score55.84
6
Document-Level Zero-Shot Relation ExtractionDocRED (dev)
Macro F1-Score45.12
5
Document-level Information ExtractionDocRED (E2E split)
Coref90.93
5
Evidence ExtractionDocRED (test)
Evi F153.01
4
Showing 25 of 30 rows