Questions
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Node Classification | questions | ROC AUC0.9703 | 161 | |
| Node classification | Questions (test) | AUROC80.02 | 97 | |
| Node Classification | Questions | Accuracy98.2 | 79 | |
| Graph Anomaly Detection | Questions | AUPRC26.8 | 59 | |
| Node Classification | Questions non-overlapping subgraph partitioning | AUC69.73 | 45 | |
| Node Classification | Questions overlapping subgraph partitioning | AUC69.39 | 39 | |
| Multiple-choice question answering | 2,000 questions dataset | ECE0.029 | 21 | |
| Node Classification | Questions v1 (test) | AUC80.49 | 20 | |
| Node Classification | Questions | Mean AUROC71.3 | 18 | |
| Node Classification | Questions | Mean macro-F154.3 | 18 | |
| Node Classification | questions (10%/10%/80% split) | AP22.76 | 18 | |
| Node Classification | Questions non-overlapping subgraph partitioning (10 Clients) | AUC68.69 | 13 | |
| Edge-level Anomaly Detection | Questions | F1-macro74.15 | 13 | |
| Node-level Anomaly Detection | Questions | F1-macro59.45 | 13 | |
| Edge-level Anomaly Detection | Questions | AUROC87.51 | 13 | |
| Node-level Anomaly Detection | Questions | AUROC0.7392 | 13 | |
| Graph Anomaly Detection | Questions (test) | AP5.12 | 11 | |
| Node Classification | Questions heterophilic graphs (test) | Accuracy79.36 | 9 | |
| Codebook utilization | Questions | Perplexity14.15 | 8 | |
| Node Classification | Questions 95% (test) | ROC-AUC77.11 | 8 | |
| Heterophilous Node Classification | Questions (test) | ROC AUC80.14 | 7 | |
| Retrieval | 100 questions cross-model comparison | F1 Score41.2 | 6 | |
| Retrieval | 519 questions full scale | F1 Score47.2 | 4 | |
| Node Classification | Questions heterophilic (test) | AUC80.49 | 4 | |
| Edge-to-Node Transfer | Questions | F1 Macro53.44 | 4 |
Showing 25 of 34 rows