Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WordNet

Benchmarks

Task NameDataset NameSOTA ResultTrend
Link PredictionWordNet noun hierarchy (transitive closure) (test)
F194.4
40
Definition GenerationWordNet
BLEU47.9
23
Transitive reasoningWordNet noun
F1 Score59.1
18
Taxonomy ExpansionWordNet (test)
Accuracy49.5
15
Taxonomy ExpansionWordNet single-parent hierarchies (test)
R@125.2
13
Multi-hop InferenceWordNet (test)
Precision (RN)89.7
12
Subtree ClassificationWordNet mammal.n.01 (test)
F1 Score94
10
Subtree ClassificationWordNet worker.n.01 (test)
F1 Score86
10
Subtree ClassificationWordNet group.n.01 (test)
F1 Score91
10
Subtree ClassificationWordNet animal.n.01 (test)
F1 Score97
10
Taxonomy ExpansionWordNet sub-taxonomies
MR (Mean Rank)40.9
9
Mixed-hop PredictionWordNet (test)
Precision (Random Negatives)89.2
9
Link PredictionWordNet Noun Hierarchy
F1 Score (0% Coverage)53.4
8
Hyperedge predictionwordnet non-k-uniform (test)
AUC0.89
7
Controlled Graph GenerationWordNet
Structural Dissimilarity (SD)31
6
Attribute-conditioned Graph GenerationWordNet
MAD1.8
6
Hierarchical ClassificationWordNet
TIE3.815
6
Taxonomy ExpansionWordNet 114 sub-taxonomies (test)
Hit@140.5
6
Taxonomy EnrichmentWordNet Verb
Scaled MRR52.4
6
Taxonomy EnrichmentWordNet Noun
Scaled MRR0.48
6
Taxonomy completionWordnet Verb subgraph (test)
Mean Rank (MR)1,286
6
Hierarchical ReconstructionWordNet Verbs full transitive closure (test)
mAP99.9
5
Network reconstructionwordnet
AUC99.4
5
Binary ClassificationWordNet (4000 withheld edges)
Accuracy90.6
5
Word embedding reconstructionWordNet noun hierarchy transitive closure
mAP86
3
Showing 25 of 28 rows