amazon-ratings
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Node Classification | amazon-ratings | Accuracy56.72 | 309 | |
| Node Classification | Amazon-Ratings (test) | Accuracy55.51 | 155 | |
| Node Classification | Amazon-ratings heterophilic (test) | Accuracy54.81 | 49 | |
| Node Classification | Amazon-ratings non-overlapping subgraph partitioning | Accuracy46.56 | 45 | |
| Node Classification | Amazon-ratings overlapping subgraph partitioning | Accuracy42.97 | 39 | |
| Out-of-Distribution Detection | Amazon Ratings | Rank1 | 24 | |
| Node Classification | Amazon-Ratings original | Accuracy53.17 | 20 | |
| Node Classification | amazon-ratings 10%/10%/80% | Average Precision46.05 | 18 | |
| Node Classification | Amazon-ratings non-overlapping subgraph partitioning (10 Clients) | Accuracy45.89 | 13 | |
| O.O.D. detection | Amazon Ratings Far-Features | AUC-PR (Alea.)30.8 | 12 | |
| O.O.D. detection | Amazon Ratings (Near-Features) | AUC-PR (Aleatoric)13.3 | 12 | |
| O.O.D. detection | Amazon Ratings LoC | AUC-PR (Aleatoric)0.149 | 12 | |
| OOD Detection | Amazon-Ratings | AUROC0.5282 | 5 | |
| Out-of-Distribution Detection | Amazon Ratings Far-Features | AUC-ROC (Aleatoric)78.2 | 2 | |
| Out-of-Distribution Detection | Amazon Ratings Near-Features | AUC-ROC (Aleatoric)62.1 | 2 | |
| Out-of-Distribution Detection | Amazon Ratings Local Class (LoC) | AUC-ROC (Aleatoric)51.4 | 2 | |
| Node Classification | Amazon-ratings overlapping subgraph partitioning (30 Clients) | Accuracy42.69 | 2 |
Showing 17 of 17 rows