Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Urban Region Pre-training and Prompting: A Graph-based Approach

About

Urban region representation is crucial for various urban downstream tasks. However, despite the proliferation of methods and their success, acquiring general urban region knowledge and adapting to different tasks remains challenging. Existing work pays limited attention to the fine-grained functional layout semantics in urban regions, limiting their ability to capture transferable knowledge across regions. Further, inadequate handling of the unique features and relationships required for different downstream tasks may also hinder effective task adaptation. In this paper, we propose a $\textbf{G}$raph-based $\textbf{U}$rban $\textbf{R}$egion $\textbf{P}$re-training and $\textbf{P}$rompting framework ($\textbf{GURPP}$) for region representation learning. Specifically, we first construct an urban region graph and develop a subgraph-centric urban region pre-training model to capture the heterogeneous and transferable patterns of entity interactions. This model pre-trains knowledge-rich region embeddings using contrastive learning and multi-view learning methods. To further refine these representations, we design two graph-based prompting methods: a manually-defined prompt to incorporate explicit task knowledge and a task-learnable prompt to discover hidden knowledge, which enhances the adaptability of these embeddings to different tasks. Extensive experiments on various urban region prediction tasks and different cities demonstrate the superior performance of our framework.

Jiahui Jin, Yifan Song, Dong Kan, Haojia Zhu, Xiangguo Sun, Zhicheng Li, Xigang Sun, Jinghui Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Check-in PredictionNYC Target from CHI & SF
R^20.728
24
Crime PredictionNYC Target from CHI & SF
R^20.545
16
Population PredictionNYC Target from CHI & SF
R^20.484
16
Service Call PredictionNYC Target from CHI & SF
R^20.396
16
Carbon PredictionNYC Target from CHI & SF
R^20.112
16
Nightlight PredictionNYC Target from CHI & SF
R^20.11
16
Check-in PredictionSF
MAE261.6
8
Carbon PredictionCHI
MAE365.4
8
Check-in PredictionNYC
MAE267
8
Check-in PredictionStaten Island Suburban (test)
R^20.153
8
Showing 10 of 55 rows

Other info

Follow for update