Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TimeSenCLIP: A Time Series Vision-Language Model for Remote Sensing

About

Vision-language models (VLMs) have shown significant promise in remote sensing applications, particularly for land-use and land-cover (LULC) mapping via zero-shot classification and retrieval. However, current approaches face several key challenges, such as the dependence on caption-based supervision, which is often not available or very limited in terms of the covered semantics, and the fact of being adapted from generic VLM architectures that are suitable for very high resolution images. Consequently, these models tend to prioritize spatial context over spectral and temporal information, limiting their effectiveness for medium-resolution remote sensing imagery. In this work, we present TimeSenCLIP, a lightweight VLM for remote sensing time series, using a cross-view temporal contrastive framework to align multispectral Sentinel-2 time series with geo-tagged ground-level imagery, without requiring textual annotations. Unlike prior VLMs, TimeSenCLIP emphasizes temporal and spectral signals over spatial context, investigating whether single-pixel time series contain sufficient information for solving a variety of tasks.

Pallavi Jain, Diego Marcos, Dino Ienco, Roberto Interdonato, Tristan Berchoux• 2025

Related benchmarks

TaskDatasetResultRank
Scenicness EstimationScenicness Dataset
Pearson's R0.66
14
Ground-to-Satellite RetrievalLand Cover
Recall@159.9
10
Ground-to-Satellite RetrievalLand Use
Recall@164.6
10
Ground-to-Satellite RetrievalOverall
Recall@144.6
10
Satellite-to-Ground RetrievalOverall
Recall@153.5
10
Showing 5 of 5 rows

Other info

Follow for update