WordNet
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Link Prediction | WordNet noun hierarchy (transitive closure) (test) | F194.4 | 40 | |
| Definition Generation | WordNet | BLEU47.9 | 23 | |
| Transitive reasoning | WordNet noun | F1 Score59.1 | 18 | |
| Taxonomy Expansion | WordNet (test) | Accuracy49.5 | 15 | |
| Multi-hop Inference | WordNet (test) | Precision (RN)89.7 | 12 | |
| Subtree Classification | WordNet mammal.n.01 (test) | F1 Score94 | 10 | |
| Subtree Classification | WordNet worker.n.01 (test) | F1 Score86 | 10 | |
| Subtree Classification | WordNet group.n.01 (test) | F1 Score91 | 10 | |
| Subtree Classification | WordNet animal.n.01 (test) | F1 Score97 | 10 | |
| Taxonomy Expansion | WordNet sub-taxonomies | MR (Mean Rank)40.9 | 9 | |
| Mixed-hop Prediction | WordNet (test) | Precision (Random Negatives)89.2 | 9 | |
| Hyperedge prediction | wordnet non-k-uniform (test) | AUC0.89 | 7 | |
| Hierarchical Classification | WordNet | TIE3.815 | 6 | |
| Taxonomy Expansion | WordNet 114 sub-taxonomies (test) | Hit@140.5 | 6 | |
| Taxonomy Enrichment | WordNet Verb | Scaled MRR52.4 | 6 | |
| Taxonomy Enrichment | WordNet Noun | Scaled MRR0.48 | 6 | |
| Taxonomy completion | Wordnet Verb subgraph (test) | Mean Rank (MR)1,286 | 6 | |
| Network reconstruction | wordnet | AUC99.4 | 5 | |
| Binary Classification | WordNet (4000 withheld edges) | Accuracy90.6 | 5 | |
| Word embedding reconstruction | WordNet noun hierarchy transitive closure | mAP86 | 3 | |
| Pair-wise edge prediction | wordnet non-k-uniform (test) | AUC0.923 | 2 | |
| Hierarchical Ancestor Retrieval | WordNet noun hierarchy (100 stratified leaf nodes) | Kendall's τ0.79 | 1 | |
| Taxonomy Expansion | WordNet | Chi-Squared Statistic100.62 | 1 |
Showing 23 of 23 rows