Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalization

About

Dynamic graph neural networks (DGNNs) are increasingly pervasive in exploiting spatio-temporal patterns on dynamic graphs. However, existing works fail to generalize under distribution shifts, which are common in real-world scenarios. As the generation of dynamic graphs is heavily influenced by latent environments, investigating their impacts on the out-of-distribution (OOD) generalization is critical. However, it remains unexplored with the following two major challenges: (1) How to properly model and infer the complex environments on dynamic graphs with distribution shifts? (2) How to discover invariant patterns given inferred spatio-temporal environments? To solve these challenges, we propose a novel Environment-Aware dynamic Graph LEarning (EAGLE) framework for OOD generalization by modeling complex coupled environments and exploiting spatio-temporal invariant patterns. Specifically, we first design the environment-aware EA-DGNN to model environments by multi-channel environments disentangling. Then, we propose an environment instantiation mechanism for environment diversification with inferred distributions. Finally, we discriminate spatio-temporal invariant patterns for out-of-distribution prediction by the invariant pattern recognition mechanism and perform fine-grained causal interventions node-wisely with a mixture of instantiated environment samples. Experiments on real-world and synthetic dynamic graph datasets demonstrate the superiority of our method against state-of-the-art baselines under distribution shifts. To the best of our knowledge, we are the first to study OOD generalization on dynamic graphs from the environment learning perspective.

Haonan Yuan, Qingyun Sun, Xingcheng Fu, Ziwei Zhang, Cheng Ji, Hao Peng, Jianxin Li• 2023

Related benchmarks

TaskDatasetResultRank
Future Link PredictionSynthetic Dataset w/ OOD
AUC70.12
30
Future Link PredictionSynthetic Dataset w/o OOD
AUC75.58
10
Future Link PredictionCOLLAB (w/o OOD)
AUC92.45
10
Future Link PredictionCOLLAB OOD
AUC84.41
10
Future Link PredictionYelp w/ OOD
AUC0.7726
10
Future Link PredictionACT w/o OOD
AUC92.37
10
Future Link PredictionACT w/ OOD
AUC82.7
10
Future Link PredictionYelp w/o OOD
AUC0.7897
10
Future Link PredictionCOLLAB p=0.4 (train)
AUC0.9297
8
Future Link PredictionCOLLAB p=0.4 (test)
AUC0.8832
8
Showing 10 of 14 rows

Other info

Code

Follow for update