Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DocRED

Benchmarks

Task NameDataset NameSOTA ResultTrend
Document-level Relation ExtractionDocRED (dev)
F1 Score63.18
235
Document-level Relation ExtractionDocRED (test)
F1 Score64.03
183
Relation ExtractionDocRED (test)
F1 Score65.92
121
Relation ExtractionDocRED (dev)
F1 Score65.69
98
Relation ExtractionDocRED v1 (test)
F167.28
66
Relation ExtractionDocRED v1 (dev)
F1 Score67.12
65
Relation ExtractionRe-DocRED (test)
Ignored F183.11
56
Document-level Relation ExtractionDocRED 1.0 (test)
F163.89
51
Relation ExtractionDocRED official (test)
RE67.53
45
Document-level Relation ExtractionDocRED 1.0 (dev)
F162.24
42
Document-level Relation ExtractionRe-DocRED (test)
Ignored F1 Score80.39
38
Relation ExtractionDocRED official (dev)
F1 Score67.41
38
Relation ExtractionDocRED human-annotated (test)
Micro F159.5
36
Document-level Relation ExtractionDocRED Long-Tail Triples (dev)
Precision0.4387
16
Evidence RetrievalDocRED (dev)
F1 Score57.55
14
Evidence RetrievalDocRED (test)
F1 Score57.34
13
Document-level Relation ExtractionEnv-Re-DocRED revised entity name variation (test)
Ignored F168.87
12
Coreference ResolutionDocRED official (test)
COREF84.96
7
Relation ExtractionDocRED
F1 Score80.2
6
Relation ExtractionDocRED (val)
Ignored F159.58
6
Mention ExtractionDocRED official (test)
ME Score93.38
6
Evidence RetrievalDocRED v1 (test)
F1 Score55.67
6
Evidence RetrievalDocRED v1 (dev)
F1 Score55.84
6
Document-Level Zero-Shot Relation ExtractionDocRED (dev)
Macro F1-Score45.12
5
Document-level Information ExtractionDocRED (E2E split)
Coref90.93
5
Showing 25 of 31 rows