FLASH: Flexible Learning of Adaptive Sampling from History in Temporal Graph Neural Networks
About
Aggregating temporal signals from historic interactions is a key step in future link prediction on dynamic graphs. However, incorporating long histories is resource-intensive. Hence, temporal graph neural networks (TGNNs) often rely on historical neighbors sampling heuristics such as uniform sampling or recent neighbors selection. These heuristics are static and fail to adapt to the underlying graph structure. We introduce FLASH, a learnable and graph-adaptive neighborhood selection mechanism that generalizes existing heuristics. FLASH integrates seamlessly into TGNNs and is trained end-to-end using a self-supervised ranking loss. We provide theoretical evidence that commonly used heuristics hinder TGNNs performance, motivating our design. Extensive experiments across multiple benchmarks demonstrate consistent and significant performance improvements for TGNNs equipped with FLASH.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Inductive dynamic link prediction | Reddit (inductive) | AUC-ROC (%)98.28 | 159 | |
| Dynamic Link Prediction | LastFM (transductive) | -- | 143 | |
| Inductive dynamic link prediction | Wikipedia (inductive) | AUC-ROC0.9861 | 116 | |
| transductive dynamic link prediction | ENRON | AUC92.5 | 112 | |
| transductive dynamic link prediction | AUC-ROC0.9901 | 105 | ||
| transductive dynamic link prediction | Social Evo. | AUC ROC95.96 | 105 | |
| Link Prediction | LastFM (inductive) | AP91.03 | 91 | |
| Future Link Prediction | SocialEvolution inductive | AP94.44 | 89 | |
| Future Link Prediction | MOOC (inductive) | AP92 | 88 | |
| Future edge prediction | REDDIT DyGLib (inductive) | AP98.5 | 75 |