Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MAG

Benchmarks

Task NameDataset NameSOTA ResultTrend
Graph Explanation FidelityMAG
Fidelity97
64
Knowledge Graph RetrievalMAG (test)
H@182.8
33
Node ExplanationMAG
Average Runtime (s)0.1
24
Object classificationMAG
Mic-F198.37
24
Node Classificationmag-year
Accuracy / F1 Score46.11
19
Node ClassificationMAG CN -> US (test)
Accuracy45.48
19
Node ClassificationMAG US -> DE (test)
Accuracy0.4613
19
Node ClassificationMAG US -> CN (test)
Accuracy41.61
19
Node ClassificationMAG
US→CN Accuracy40.77
14
Node ClassificationMAG (test)
Macro F1 Score34.99
14
Multi-class Edge ClassificationMAG
BACC81.2
14
Multimodal RetrievalMAG Toys benchmark
R@187.4
13
kNN classificationMAG (test)
kNN Accuracy (MAG Test)41.7
12
Structural PreservationMAG
Spearman Correlation53.6
12
2-hop neighbor recallMAG
Top-10 2-hop Recall30.9
12
Link PredictionMAG
AUC (MAG)1
12
Linear classificationMAG (random)
Accuracy34.2
12
Node ClassificationMAG CN→FR
Accuracy32.03
11
Node ClassificationMAG CN→RU
Accuracy45.95
11
Node ClassificationMAG CN→JP
Accuracy47.45
11
Node ClassificationMAG CN→DE
Accuracy40.11
11
Node ClassificationMAG US→FR
Accuracy42.98
11
Node ClassificationMAG US→RU
Accuracy48.87
11
Node ClassificationMAG US→JP
Accuracy51.81
11
Node EmbeddingMAG
Neighbor Recall89
10
Showing 25 of 38 rows