Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Link Prediction on CODEx L (test)
Loading...
0.345
MRR
Supervised SOTA
0.05172
0.12786
0.204
0.28014
Jun 23, 2021
Nov 9, 2021
Mar 28, 2022
Aug 14, 2022
Dec 31, 2022
May 19, 2023
Oct 6, 2023
MRR
Hits@10
Success Rate
Updated 4d ago
Evaluation Results
Method
Method
Links
MRR
Hits@10
Success Rate
Supervised SOTA
Training Regime=Superv...
2023.10
0.345
0.473
-
ULTRA
Training Regime=Fine-t...
2023.10
0.343
0.478
-
ULTRA
Training Regime=Zero-shot
2023.10
0.338
0.469
-
RotatE
Dimension=500d, Vocabu...
2021.06
0.258
0.387
100
NodePiece + RotatE (no relational context)
Ablation=no relational...
2021.06
0.201
0.332
86
RotatE
Dimension=20d, Vocabul...
2021.06
0.196
0.322
83
NodePiece + RotatE
Vocabulary size (|V|)=...
2021.06
0.19
0.313
81
NodePiece + RotatE (no distances)
Ablation=no distances,...
2021.06
0.179
0.302
78
NodePiece + RotatE (rels only, no anchors)
Ablation=no anchors, V...
2021.06
0.063
0.121
31
Feedback
Search any
task
Search any
task