Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Empowering Graph Representation Learning with Test-Time Graph Transformation

About

As powerful tools for representation learning on graphs, graph neural networks (GNNs) have facilitated various applications from drug discovery to recommender systems. Nevertheless, the effectiveness of GNNs is immensely challenged by issues related to data quality, such as distribution shift, abnormal features and adversarial attacks. Recent efforts have been made on tackling these issues from a modeling perspective which requires additional cost of changing model architectures or re-training model parameters. In this work, we provide a data-centric view to tackle these issues and propose a graph transformation framework named GTrans which adapts and refines graph data at test time to achieve better performance. We provide theoretical analysis on the design of the framework and discuss why adapting graph data works better than adapting the model. Extensive experiments have demonstrated the effectiveness of GTrans on three distinct scenarios for eight benchmark datasets where suboptimal data is presented. Remarkably, GTrans performs the best in most cases with improvements up to 2.8%, 8.2% and 3.8% over the best baselines on three experimental settings. Code is released at https://github.com/ChandlerBang/GTrans.

Wei Jin, Tong Zhao, Jiayuan Ding, Yozen Liu, Jiliang Tang, Neil Shah• 2022

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora
Accuracy80.79
1215
Node ClassificationCiteseer
Accuracy69.51
1037
Node ClassificationPubmed
Accuracy78.67
865
Node ClassificationwikiCS
Accuracy76.39
329
Node ClassificationDBLP
Accuracy34.47
78
Node ClassificationCora Covariate shift (degree split)
OOD Accuracy60.93
50
Node ClassificationDBLP & ACM A to D
Accuracy59.61
50
Graph Out-of-Distribution DetectionBZR (ID) COX2 (OOD)
AUC0.5517
49
Node ClassificationArxiv Source: 1950-2011, Target: 2014-2016
Accuracy58.72
44
Node ClassificationArxiv Source: 1950-2007, Target: 2014-2016
Accuracy49.1
44
Showing 10 of 110 rows
...

Other info

Follow for update