MAG
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Graph Retrieval | MAG (test) | H@182.8 | 33 | |
| Object classification | MAG | Mic-F198.37 | 24 | |
| Node Classification | mag-year | Accuracy / F1 Score46.11 | 19 | |
| Node Classification | MAG CN -> US (test) | Accuracy45.48 | 19 | |
| Node Classification | MAG US -> DE (test) | Accuracy0.4613 | 19 | |
| Node Classification | MAG US -> CN (test) | Accuracy41.61 | 19 | |
| Node Classification | MAG | US→CN Accuracy40.77 | 14 | |
| Node Classification | MAG (test) | Macro F1 Score34.99 | 14 | |
| Multi-class Edge Classification | MAG | BACC81.2 | 14 | |
| Multimodal Retrieval | MAG Toys benchmark | R@187.4 | 13 | |
| Node Classification | MAG CN→FR | Accuracy32.03 | 11 | |
| Node Classification | MAG CN→RU | Accuracy45.95 | 11 | |
| Node Classification | MAG CN→JP | Accuracy47.45 | 11 | |
| Node Classification | MAG CN→DE | Accuracy40.11 | 11 | |
| Node Classification | MAG US→FR | Accuracy42.98 | 11 | |
| Node Classification | MAG US→RU | Accuracy48.87 | 11 | |
| Node Classification | MAG US→JP | Accuracy51.81 | 11 | |
| Node Classification | MAG FR → JP | Accuracy60.05 | 9 | |
| Node Classification | MAG FR → RU | Performance85.15 | 9 | |
| Node Classification | MAG | Accuracy78.37 | 8 | |
| Node Classification | MAG CN -> FR (test) | Accuracy34.42 | 8 | |
| Node Classification | MAG CN -> RU (test) | Accuracy36.68 | 8 | |
| Node Classification | MAG CN -> JP (test) | Accuracy43.28 | 8 | |
| Node Classification | MAG CN -> DE (test) | Accuracy31.55 | 8 | |
| Node Classification | MAG US -> FR (test) | Accuracy32.29 | 8 |
Showing 25 of 30 rows