Location Is All You Need: Continuous Spatiotemporal Neural Representations of Earth Observation Data
About
In this work, we present LIANet (Location Is All You Need Network), a coordinate-based neural representation that models multi-temporal spaceborne Earth observation (EO) data for a given region of interest as a continuous spatiotemporal neural field. Given only spatial and temporal coordinates, LIANet reconstructs the corresponding satellite imagery. Once pretrained, this neural representation can be adapted to various EO downstream tasks, such as semantic segmentation or pixel-wise regression, importantly, without requiring access to the original satellite data. LIANet intends to serve as a user-friendly alternative to Geospatial Foundation Models (GFMs) by eliminating the overhead of data access and preprocessing for end-users and enabling fine-tuning solely based on labels. We demonstrate the pretraining of LIANet across target areas of varying sizes and show that fine-tuning it for downstream tasks achieves competitive performance compared to training from scratch or using established GFMs. The source code and datasets are publicly available at https://github.com/mojganmadadi/LIANet/tree/v1.0.1.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Pixel-wise classification | Dominant Leaf Type Area of interest A+ | IoU84 | 26 | |
| Regression | Canopy Height (Area of interest A+) | MAE0.047 | 13 | |
| Pixel-wise classification | Dominant Leaf Type | mIoU78 | 13 | |
| Regression | Building Density (Area A0) | MAE0.021 | 13 | |
| Pixel-wise classification | Dynamic World (Area A0) | mIoU72 | 13 | |
| Regression | Canopy Height Area A0 | MAE0.052 | 13 | |
| Pixel-wise classification | Dynamic World (Area of interest A+) | mIoU70 | 13 | |
| Regression | Building Density (Area of interest A+) | MAE0.021 | 13 | |
| Regression | Canopy Height | MAE0.055 | 13 | |
| Regression | Building Density | Mean Absolute Error0.026 | 13 |