Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Temporal Graph Pattern Machine

About

Temporal graph learning is pivotal for deciphering dynamic systems, where the core challenge lies in explicitly modeling the underlying evolving patterns that govern network transformation. However, prevailing methods are predominantly task-centric and rely on restrictive assumptions -- such as short-term dependency modeling, static neighborhood semantics, and retrospective time usage. These constraints hinder the discovery of transferable temporal evolution mechanisms. To address this, we propose the Temporal Graph Pattern Machine (TGPM), a foundation framework that shifts the focus toward directly learning generalized evolving patterns. TGPM conceptualizes each interaction as an interaction patch synthesized via temporally-biased random walks, thereby capturing multi-scale structural semantics and long-range dependencies that extend beyond immediate neighborhoods. These patches are processed by a Transformer-based backbone designed to capture global temporal regularities while adapting to context-specific interaction dynamics. To further empower the model, we introduce a suite of self-supervised pre-training tasks -- specifically masked token modeling and next-time prediction -- to explicitly encode the fundamental laws of network evolution. Extensive experiments show that TGPM consistently achieves state-of-the-art performance in both transductive and inductive link prediction, demonstrating exceptional cross-domain transferability. Our code has been released in https://github.com/antman9914/TGPM.

Yijun Ma, Zehong Wang, Weixiang Sun, Yanfang Ye• 2026

Related benchmarks

TaskDatasetResultRank
Temporal Link PredictionICEWS1819 transductive
ROC-AUC0.9251
8
Temporal Link PredictionGooglemap CT transductive
ROC-AUC0.8892
8
Temporal Link PredictionICEWS inductive 1819
ROC-AUC78.64
8
Temporal Link PredictionGooglemap CT inductive
ROC-AUC (%)79.84
8
Showing 4 of 4 rows

Other info

Follow for update