T-REx
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Slot Filling | T-REx | Coverage EM65.07 | 20 | |
| Open-set knowledge retrieval | T-REx (Hard) | Macro EM32.1 | 19 | |
| Open-set knowledge retrieval | T-REx (UHN) | Macro EM0.316 | 19 | |
| Open-set knowledge retrieval | T-REx (All) | Macro-averaged EM34.5 | 19 | |
| Slot-Filling | T-REx | Accuracy66.95 | 14 | |
| Soft-Filling | T-REx (test) | Accuracy65.91 | 8 | |
| Relation Extraction | T-REx | Accuracy87.7 | 8 | |
| Unsupervised Relation Extraction | T-REx DS (test) | B3 F142.9 | 8 | |
| Unsupervised Relation Extraction | T-REx SPO (test) | B3 F145 | 8 | |
| Slot Filling | T-REx KILT Leaderboard (test) | Accuracy84.36 | 7 | |
| Factual Probe | T-REx | P@1 (Total)85 | 6 | |
| Knowledge assessment | T-REx (410 randomly sampled facts) | Recall95.18 | 5 | |
| Slot Filling | T-REx KILT (test) | KILT Accuracy27.84 | 4 | |
| Entity Linking | T-REx Wikidata (test) | Precision75 | 3 |
Showing 14 of 14 rows