From Subtle to Significant: Prompt-Driven Self-Improving Optimization in Test-Time Graph OOD Detection
About
Graph Out-of-Distribution (OOD) detection aims to identify whether a test graph deviates from the distribution of graphs observed during training, which is critical for ensuring the reliability of Graph Neural Networks (GNNs) when deployed in open-world scenarios. Recent advances in graph OOD detection have focused on test-time training techniques that facilitate OOD detection without accessing potential supervisory information (e.g., training data). However, most of these methods employ a one-pass inference paradigm, which prevents them from progressively correcting erroneous predictions to amplify OOD signals. To this end, we propose a \textbf{S}elf-\textbf{I}mproving \textbf{G}raph \textbf{O}ut-\textbf{o}f-\textbf{D}istribution detector (SIGOOD), which is an unsupervised framework that integrates continuous self-learning with test-time training for effective graph OOD detection. Specifically, SIGOOD generates a prompt to construct a prompt-enhanced graph that amplifies potential OOD signals. To optimize prompts, SIGOOD introduces an Energy Preference Optimization (EPO) loss, which leverages energy variations between the original test graph and the prompt-enhanced graph. By iteratively optimizing the prompt by involving it into the detection model in a self-improving loop, the resulting optimal prompt-enhanced graph is ultimately used for OOD detection. Comprehensive evaluations on 21 real-world datasets confirm the effectiveness and outperformance of our SIGOOD method. The code is at https://github.com/Ee1s/SIGOOD.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Graph Anomaly Detection | MUTAG | AUROC0.857 | 23 | |
| Graph Out-of-Distribution Detection | BZR (ID) COX2 (OOD) | AUC0.8736 | 13 | |
| Graph Out-of-Distribution Detection | AIDS DHFR ID OOD | AUC97.38 | 13 | |
| Graph Out-of-Distribution Detection | ENZYMES ID PROTEIN OOD | AUC (%)67.88 | 13 | |
| Graph Out-of-Distribution Detection | Tox21 SIDER ID OOD | AUC (%)69.97 | 13 | |
| Graph Out-of-Distribution Detection | FreeSolv ID ToxCast OOD | AUC0.6889 | 13 | |
| Graph Out-of-Distribution Detection | ClinTox ID LIPO OOD | AUC0.7133 | 13 | |
| Graph Out-of-Distribution Detection | Esol MUV ID OOD | AUC0.8772 | 13 | |
| Graph Anomaly Detection | MMP | AUC0.7017 | 9 | |
| Graph Anomaly Detection | PROTEINS full | AUC79.54 | 9 |