Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Prompt-Based Spatio-Temporal Graph Transfer Learning

About

Spatio-temporal graph neural networks have proven efficacy in capturing complex dependencies for urban computing tasks such as forecasting and kriging. Yet, their performance is constrained by the reliance on extensive data for training on a specific task, thereby limiting their adaptability to new urban domains with varied task demands. Although transfer learning has been proposed to remedy this problem by leveraging knowledge across domains, the cross-task generalization still remains under-explored in spatio-temporal graph transfer learning due to the lack of a unified framework. To bridge the gap, we propose Spatio-Temporal Graph Prompting (STGP), a prompt-based framework capable of adapting to multi-diverse tasks in a data-scarce domain. Specifically, we first unify different tasks into a single template and introduce a task-agnostic network architecture that aligns with this template. This approach enables capturing dependencies shared across tasks. Furthermore, we employ learnable prompts to achieve domain and task transfer in a two-stage prompting pipeline, facilitating the prompts to effectively capture domain knowledge and task-specific properties. Our extensive experiments demonstrate that STGP outperforms state-of-the-art baselines in three tasks-forecasting, kriging, and extrapolation-achieving an improvement of up to 10.7%.

Junfeng Hu, Xu Liu, Zhencheng Fan, Yifang Yin, Shili Xiang, Savitha Ramasamy, Roger Zimmermann• 2024

Related benchmarks

TaskDatasetResultRank
Traffic ForecastingMETR-LA
MAE2.2983
415
Traffic ForecastingPEMS-BAY
MAE1.1725
161
Traffic PredictionPeMS04 to PeMS08
MAE17.346
45
Traffic PredictionChengdu
MAE (10 min)1.8978
42
Traffic PredictionShenzhen
MAE (10 min)1.7658
42
Traffic PredictionPEMS-BAY
MAE (5 min Horizon)1.16
4
Traffic PredictionDiDi-Chengdu
MAE (10 min)2.19
4
Traffic PredictionDiDi-Shenzhen
MAE (10 min)1.95
4
Showing 8 of 8 rows

Other info

Follow for update