Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FewRel

Benchmarks

Task NameDataset NameSOTA ResultTrend
Few-shot Relation ExtractionFewRel Biomedical domain 2.0 (test)
Accuracy87.9
36
Few-shot Relation ClassificationFewRel 1.0 (test)
Accuracy0.971
36
Relation ClassificationFewRel (test)
Precision0.9015
22
Relation ExtractionFewRel
Micro-F187.34
19
Few-shot Relation ClassificationFewRel 2.0
Accuracy (5-way 1-shot)0.6741
18
Relation ExtractionFewRel (test)
Micro-F155.02
16
Zero-shot Triplet ExtractionFewRel (test)
Accuracy30.71
15
Few-shot Relation ExtractionFewRel 1.0
Accuracy (5-way 1-shot)90.3
13
Relation Triplet ExtractionFewRel (test)
Accuracy27.3
12
Relation ExtractionFewRel 10-way 5-shot 1.0
Accuracy91.9
8
Relation ExtractionFewRel 10-way 1-shot 1.0
Accuracy88.2
8
Relation ExtractionFewRel 5-way 5-shot 1.0
Accuracy96
8
Relation ExtractionFewRel 5-way 1-shot 1.0
Accuracy92.6
8
Relation ClassificationFewRel
Accuracy93.5
8
open-set relation extractionFewRel (test)
Accuracy74
8
Continual Relation ExtractionFewRel (incremental)
T198.8
8
Few-shot Relation ExtractionFewRel Domain Adaptation 2.0
Acc (5-way 1-shot)73.98
8
Open Relation ExtractionFewRel (test)
B3 Precision75.2
7
Relation ClassificationFewRel 1.0
5-way 1-shot Acc98.4
7
Open-world Relation ExtractionFewRel (unlabeled)
Precision86.06
7
Zero-shot Relation ExtractionFewRel m=15 (test)
Precision74.33
7
Zero-shot Relation ExtractionFewRel m=10 (test)
Precision83.21
7
Zero-shot Relation ExtractionFewRel m=5 (test)
Precision92.82
7
Relation ExtractionFewRel 10-way 5-shot
T194.87
7
Relation ExtractionFewRel 10-way 10-shot (test)
Top-1 Accuracy95.82
7
Showing 25 of 41 rows