Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Structural Re-weighting Improves Graph Domain Adaptation

About

In many real-world applications, graph-structured data used for training and testing have differences in distribution, such as in high energy physics (HEP) where simulation data used for training may not match real experiments. Graph domain adaptation (GDA) is a method used to address these differences. However, current GDA primarily works by aligning the distributions of node representations output by a single graph neural network encoder shared across the training and testing domains, which may often yield sub-optimal solutions. This work examines different impacts of distribution shifts caused by either graph structure or node attributes and identifies a new type of shift, named conditional structure shift (CSS), which current GDA approaches are provably sub-optimal to deal with. A novel approach, called structural reweighting (StruRW), is proposed to address this issue and is tested on synthetic graphs, four benchmark datasets, and a new application in HEP. StruRW has shown significant performance improvement over the baselines in the settings with large graph structure shifts, and reasonable performance improvement when node attribute shift dominates.

Shikun Liu, Tianchun Li, Yongbin Feng, Nhan Tran, Han Zhao, Qiu Qiang, Pan Li• 2023

Related benchmarks

TaskDatasetResultRank
Graph ClassificationCOX2_MD to COX2 (target)
Accuracy64.5
65
Node ClassificationAminer
Micro F159.63
46
Graph ClassificationMutagenicity Edge Shift M0→M2
Accuracy75.6
43
Node ClassificationSocial domains Blog2 to Blog1
Micro-F142.01
42
Graph ClassificationSpurious-Motif → Spurious-Motif_bias Corr. Shift S→SB
Accuracy52.7
41
Graph ClassificationBZR to BZR_MD (target)
Accuracy61.5
37
Graph ClassificationBZR_MD to BZR (target)
Accuracy78.2
37
Node ClassificationSocial domains Blog1 to Blog2
Micro-F140.37
33
Graph ClassificationMutagenicity Edge Shift M0→M1
Accuracy74.2
28
Graph ClassificationPROTEINS → DD Feature Shift
Accuracy53.2
28
Showing 10 of 69 rows

Other info

Follow for update