Wikidata
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Link Prediction | Wikidata5M (test) | MRR0.493 | 58 | |
| Knowledge Insertion | WikiData recent | Edit Success Rate100 | 43 | |
| Factual Knowledge Evaluation | Wikidata knowledge infusion | Accuracy64.69 | 18 | |
| Knowledge modification | WikiData counterfact | Edit Success Rate100 | 15 | |
| Inductive Link Prediction | Wikidata5M IND (test) | MRR0.799 | 13 | |
| Relation Extraction | WIKIDATA one-shot (out-of-distribution) | Precision66.66 | 12 | |
| Source Classification | Wikidata (test) | Macro F186.2 | 12 | |
| Relation Classification | Wikidata (test) | Macro F185.36 | 12 | |
| Sentential Relation Extraction | Wikidata (test) | Precision88.6 | 12 | |
| Temporal Link Prediction | WIKIDATA Interpolation 12k (test) | Hits@10.2505 | 10 | |
| Knowledge Graph Completion | Wikidata inductive 5M (test) | MRR71.4 | 8 | |
| Knowledge Graph Completion | Wikidata transductive 5M (test) | MRR0.358 | 8 | |
| Link Prediction | wikidata12k | MRR0.334 | 7 | |
| Interpolation reasoning | Wikidata | MRR47.69 | 7 | |
| List-based question answering | Wikidata Easier (test) | Precision36 | 6 | |
| Knowledge Insertion | WikiData recent (test) | Edit Success Rate100 | 5 | |
| Factual Probing | Wikidata | MRR0.31 | 5 | |
| Schema Matching | WikiData | Recall94 | 4 | |
| Temporal Knowledge Graph Completion | Wikidata (test) | MRR0.45 | 3 | |
| Entity Alignment | Wikidata zh-my 2014 | Hits@143.49 | 2 | |
| Entity Alignment | Wikidata zh-lo 2014 | Hits@10.6215 | 2 | |
| Entity Alignment | Wikidata zh-th 2014 | Hits@124.07 | 2 | |
| Entity Alignment | Wikidata zh-km 2014 | Hits@167.25 | 2 |
Showing 23 of 23 rows