WD50K
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Link Prediction | WD50K | MRR0.759 | 22 | |
| Entity Prediction | WD50K | MRR0.419 | 15 | |
| Fact Generation (Arbitrary Masking) | WD50K | Accuracy60.4 | 13 | |
| Fact Generation (Targeted) | WD50K | Accuracy50.8 | 13 | |
| Entity Prediction | WD50K all entities | MRR0.554 | 8 | |
| Entity Prediction | WD50K subject object | MRR39.5 | 8 | |
| Relation Prediction | WD50K | MRR0.968 | 6 | |
| Complex Query Answering | WD50K-NFOL n-ary (test) | Avg P Score36.87 | 6 | |
| Node Classification | WD50K triple version (10% labeled) | ROC AUC98.4 | 6 | |
| Node Classification | WD50K triple (5% labeled) | ROC-AUC98.4 | 6 | |
| Link Prediction | WD50K standard 13.6% qualifier ratio | MRR0.349 | 5 | |
| Link Prediction | WD50K 100% facts with qualifiers | MRR69.5 | 5 | |
| Link Prediction | WD50K 66% facts with qualifiers | MRR51.1 | 5 | |
| Link Prediction | WD50K 33% facts with qualifiers | MRR33.6 | 5 | |
| Complex Query Answering | WD50K-QE n-ary (test) | AvgP75.84 | 4 | |
| Relation Prediction (all relations) | WD50K | MRR0.927 | 4 | |
| Relation Prediction (main relation) | WD50K | MRR91.6 | 4 |
Showing 17 of 17 rows