Structural Re-weighting Improves Graph Domain Adaptation
About
In many real-world applications, graph-structured data used for training and testing have differences in distribution, such as in high energy physics (HEP) where simulation data used for training may not match real experiments. Graph domain adaptation (GDA) is a method used to address these differences. However, current GDA primarily works by aligning the distributions of node representations output by a single graph neural network encoder shared across the training and testing domains, which may often yield sub-optimal solutions. This work examines different impacts of distribution shifts caused by either graph structure or node attributes and identifies a new type of shift, named conditional structure shift (CSS), which current GDA approaches are provably sub-optimal to deal with. A novel approach, called structural reweighting (StruRW), is proposed to address this issue and is tested on synthetic graphs, four benchmark datasets, and a new application in HEP. StruRW has shown significant performance improvement over the baselines in the settings with large graph structure shifts, and reasonable performance improvement when node attribute shift dominates.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Graph Classification | COX2_MD to COX2 (target) | Accuracy64.5 | 65 | |
| Node Classification | Aminer | Micro F159.63 | 46 | |
| Graph Classification | Mutagenicity Edge Shift M0→M2 | Accuracy75.6 | 43 | |
| Node Classification | Social domains Blog2 to Blog1 | Micro-F142.01 | 42 | |
| Graph Classification | Spurious-Motif → Spurious-Motif_bias Corr. Shift S→SB | Accuracy52.7 | 41 | |
| Graph Classification | BZR to BZR_MD (target) | Accuracy61.5 | 37 | |
| Graph Classification | BZR_MD to BZR (target) | Accuracy78.2 | 37 | |
| Node Classification | Social domains Blog1 to Blog2 | Micro-F140.37 | 33 | |
| Graph Classification | Mutagenicity Edge Shift M0→M1 | Accuracy74.2 | 28 | |
| Graph Classification | PROTEINS → DD Feature Shift | Accuracy53.2 | 28 |