Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DyG-Mamba: Continuous State Space Modeling on Dynamic Graphs

About

Dynamic graph modeling aims to uncover evolutionary patterns in real-world systems, enabling accurate social recommendation and early detection of cancer cells. Inspired by the success of recent state space models in efficiently capturing long-term dependencies, we propose DyG-Mamba by translating dynamic graph modeling into a long-term sequence modeling problem. Specifically, inspired by Ebbinghaus' forgetting curve, we treat the irregular timespans between events as control signals, allowing DyG-Mamba to dynamically adjust the forgetting of historical information. This mechanism ensures effective usage of irregular timespans, thereby improving both model effectiveness and inductive capability. In addition, inspired by Ebbinghaus' review cycle, we redefine core parameters to ensure that DyG-Mamba selectively reviews historical information and filters out noisy inputs, further enhancing the model's robustness. Through exhaustive experiments on 12 datasets covering dynamic link prediction and node classification tasks, we show that DyG-Mamba achieves state-of-the-art performance on most datasets, while demonstrating significantly improved computational and memory efficiency. Code is available at https://github.com/Clearloveyuan/DyG-Mamba.

Dongyuan Li, Shiyin Tan, Ying Zhang, Ming Jin, Shirui Pan, Manabu Okumura, Renhe Jiang• 2024

Related benchmarks

TaskDatasetResultRank
Inductive dynamic link predictionReddit (inductive)--
159
Dynamic Link PredictionLastFM (transductive)
AP94.23
143
Dynamic Link PredictionWikipedia (inductive)
AP98.65
119
Dynamic Link PredictionReddit (transductive)
AP99.27
92
Dynamic Link PredictionMOOC (transductive)
AP90.25
80
Dynamic Link PredictionSocial Evo. (transductive)
AP97.78
57
Inductive dynamic link predictionLastFM
AP (LastFM)95.13
53
Dynamic Link PredictionEnron (transductive)
AP93.14
51
Dynamic Link PredictionUCI (transductive)
AP96.14
48
Inductive dynamic link predictionMOOC (inductive)
AP90.2
42
Showing 10 of 14 rows

Other info

Follow for update