Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Squirrel

Benchmarks

Task NameDataset NameSOTA ResultTrend
Node ClassificationSquirrel
Accuracy83.49
500
Node classificationSquirrel (test)
Mean Accuracy76.01
234
Node ClassificationSquirrel 60%/20%/20% random splits
Accuracy62.14
44
Node ClassificationSquirrel (fixed)
Accuracy61.81
42
Node ClassificationSquirrel (48/32/20)
Mean Accuracy74.1
40
Node ClassificationSquirrel filtered
Accuracy41.8
35
Node ClassificationSquirrel Standard (test)
Accuracy61.81
33
Node ClassificationSquirrel (10 different splits)
Accuracy0.6181
27
Node ClassificationSquirrel dense filtered
Accuracy42.66
26
Node ClassificationSquirrel dense split original
Accuracy68.93
26
Node ClassificationSquirrel Undirected (test)
Accuracy64.23
23
Node unlearningSquirrel
Average Runtime (s)0.01
20
Node RegressionSquirrel
Normalized MAE Loss0.589
20
Node clusteringSquirrel (test)
Conductance0.24
15
Node ClassificationSquirrel homophily: 0.22 (test)
Accuracy57.32
15
Node ClassificationSquirrel Hnode = 0.22
Accuracy61.48
14
Node ClassificationSquirrel original (test)
Accuracy72.24
14
Node ClassificationSquirrel Heterophilous (train val test)
Accuracy61.8
12
Node ClassificationSquirrel heterophilic (test)
Accuracy68.76
12
Node ClassificationSquirrel (full-supervised)
Mean Accuracy59.77
11
Node ClassificationSquirrel semi-supervised (test)
Mean Accuracy30.91
11
Node-level Out-of-Distribution DetectionSquirrel (test)
AUROC (aleatoric)0.7502
10
Node ClassificationSquirrel protocol (random)
Accuracy35.17
10
Node ClassificationSquirrel (dense)
Mean Accuracy49.93
10
node-level taskSquirrel
Max GPU Memory (MB)1.436
9
Showing 25 of 41 rows