Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Empowering Graph Representation Learning with Test-Time Graph Transformation

About

As powerful tools for representation learning on graphs, graph neural networks (GNNs) have facilitated various applications from drug discovery to recommender systems. Nevertheless, the effectiveness of GNNs is immensely challenged by issues related to data quality, such as distribution shift, abnormal features and adversarial attacks. Recent efforts have been made on tackling these issues from a modeling perspective which requires additional cost of changing model architectures or re-training model parameters. In this work, we provide a data-centric view to tackle these issues and propose a graph transformation framework named GTrans which adapts and refines graph data at test time to achieve better performance. We provide theoretical analysis on the design of the framework and discuss why adapting graph data works better than adapting the model. Extensive experiments have demonstrated the effectiveness of GTrans on three distinct scenarios for eight benchmark datasets where suboptimal data is presented. Remarkably, GTrans performs the best in most cases with improvements up to 2.8%, 8.2% and 3.8% over the best baselines on three experimental settings. Code is released at https://github.com/ChandlerBang/GTrans.

Wei Jin, Tong Zhao, Jiayuan Ding, Yozen Liu, Jiliang Tang, Neil Shah• 2022

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora
Accuracy80.79
885
Node ClassificationCiteseer
Accuracy69.51
804
Node ClassificationPubmed
Accuracy78.67
742
Node ClassificationwikiCS
Accuracy76.39
198
Node ClassificationCora Covariate shift (degree split)
OOD Accuracy60.93
50
Node ClassificationWebKB university split Covariate shift
OOD Test Accuracy21.69
30
Node ClassificationWebKB university split Concept shift
OOD Test Accuracy26.91
30
Graph Anomaly DetectionMUTAG
AUROC0.6238
23
Node ClassificationArxiv overall
Accuracy71.77
17
Node ClassificationCBAS color split Concept shift
OOD Test Accuracy73.57
15
Showing 10 of 60 rows

Other info

Follow for update