Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HLS-GPT: A Generative Pretrained Transformer (GPT) for Continental-Scale NASA Harmonized Landsat and Sentinel-2 (HLS) Reflectance Reconstruction Across All Bands on Arbitrary Dates

About

Recent deep learning methods for Landsat and Sentinel-2 reflectance time series reconstruction remain limited by restricted spectral coverage, limited geographic scalability, or patch-based designs with short temporal contexts. We present HLS-GPT, a large-scale generative pretrained Transformer model for reconstructing NASA Harmonized Landsat Sentinel-2 30 m surface reflectance for all bands, any date, and any pixel location. HLS-GPT uses a hierarchical Transformer architecture to handle the different spectral band configurations of Landsat and Sentinel-2 and operates on single-pixel 12-month time series. To capture geographic and seasonal variability, the model was trained with nine years of HLS time series from more than 0.25 million training pixels across the conterminous United States. A random cropping and masking strategy extracts 12-month periods with varying start dates across epochs, masks 50% of valid observations, and trains the model to reconstruct the masked reflectance values from the remaining observations. Evaluation using more than 62,000 independent test pixels shows robust reconstruction under diverse land surface conditions, including complex crop phenology and sparse, irregular observations. Leave-one-observation-out evaluation achieved reconstruction RMSE below 0.026 for all HLS spectral bands, with relative RMSE below 35% for visible bands and below 13% for other bands. Red-edge band errors were comparable to red and near-infrared errors despite the absence of red-edge bands on Landsat. Sensitivity analyses that randomly masked 10% to 90% of test observations showed only modest degradation when 10% to 50% of observations were masked, with all-band RMSE below 0.028. Image reconstruction over nine independent 109 by 109 km CONUS HLS tiles further demonstrates that HLS-GPT outperforms two conventional methods and the NASA-IBM Prithvi model.

Junjie Li, Hankui K. Zhang, David P. Roy• 2026

Related benchmarks

TaskDatasetResultRank
Image ReconstructionHLS Oregon California 10TDM
RMSE (All Bands, Tile)0.0052
4
Image ReconstructionHLS Montana 11TQM
RMSE (all bands/tile)0.0062
4
Image ReconstructionHLS California 11SPS
RMSE (All Bands, Tile)0.0139
4
Image ReconstructionHLS Utah 12TVL
RMSE (all bands/tile)0.0103
4
Image ReconstructionHLS Colorado (13SEC)
RMSE (all bands/tiles)0.0052
4
Image ReconstructionHLS South Dakota 14TNP
RMSE (all bands/tile)0.0158
4
Image ReconstructionHLS Missouri 15SWB
RMSE0.0086
4
Image ReconstructionHLS Florida 17RNL
RMSE (all bands/tiles)0.0114
4
Image ReconstructionHLS New York 18TWN
RMSE (all bands/tile)0.0082
4
Spectral Band ReconstructionHLS (nine evaluation tiles) Blue band v1.0 (test)
RMSE0.0052
4
Showing 10 of 16 rows

Other info

Follow for update