Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalization
About
Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As the generation of dynamic graphs is heavily influenced by latent environments, investigating their impacts on the out-of-distribution (OOD) generalization is critical. However, it remains unexplored with the following two major challenges: (1) How to properly model and infer the complex environments on dynamic graphs with distribution shifts? (2) How to discover invariant patterns given inferred spatio-temporal environments? To solve these challenges, we propose a novel Environment-Aware dynamic Graph LEarning (EAGLE) framework for OOD generalization by modeling complex coupled environments and exploiting spatio-temporal invariant patterns. Specifically, we first design the environment-aware EA-DGNN to model environments by multi-channel environments disentangling. Then, we propose an environment instantiation mechanism for environment diversification with inferred distributions. Finally, we discriminate spatio-temporal invariant patterns for out-of-distribution prediction by the invariant pattern recognition mechanism and perform fine-grained causal interventions node-wisely with a mixture of instantiated environment samples. Experiments on real-world and synthetic dynamic graph datasets demonstrate the superiority of our method against state-of-the-art baselines under distribution shifts. To the best of our knowledge, we are the first to study OOD generalization on dynamic graphs from the environment learning perspective.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Future Link Prediction | Synthetic Dataset w/ OOD | AUC70.12 | 30 | |
| Future Link Prediction | Synthetic Dataset w/o OOD | AUC75.58 | 10 | |
| Future Link Prediction | COLLAB (w/o OOD) | AUC92.45 | 10 | |
| Future Link Prediction | COLLAB OOD | AUC84.41 | 10 | |
| Future Link Prediction | Yelp w/ OOD | AUC0.7726 | 10 | |
| Future Link Prediction | ACT w/o OOD | AUC92.37 | 10 | |
| Future Link Prediction | ACT w/ OOD | AUC82.7 | 10 | |
| Future Link Prediction | Yelp w/o OOD | AUC0.7897 | 10 | |
| Future Link Prediction | COLLAB p=0.4 (train) | AUC0.9297 | 8 | |
| Future Link Prediction | COLLAB p=0.4 (test) | AUC0.8832 | 8 |