Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation Learning

About

We introduce HQ-JEPA, a hybrid quantum-classical joint-embedding predictive architecture for cross-modal remote sensing representation learning. The proposed framework extends JEPA-style masked latent prediction to paired Sentinel-1 and Sentinel-2 imagery by predicting masked target representations from visible context regions while aligning heterogeneous modality features in a shared embedding space. To improve representation quality, HQ-JEPA combines four complementary objectives: latent token prediction, cross-modal token alignment, SIGReg-based Gaussian regularization in the fused latent space, and a differentiable SWAP-test-based Fidelity Quantum Similarity (FQS) loss. Unlike pixel reconstruction methods, HQ-JEPA learns semantic representations directly in latent space and uses quantum state-overlap-based similarity as an additional regularization signal. We evaluate the pretrained encoder on GeoBench classification and segmentation tasks under linear probing and fine-tuning settings. Results show that HQ-JEPA achieves competitive and often superior performance over strong self-supervised and remote sensing foundation-model baselines, demonstrating the benefit of integrating predictive self-supervision, cross-modal geometric regularization, and quantum fidelity-based representation learning for remote sensing applications.

Md Aminur Hossain, Ayush V. Patel, Sanjay K. Singh, Biplab Banerjee• 2026

Related benchmarks

TaskDatasetResultRank
Segmentationm-SA crop-type
Mean mIoU38.26
27
Classificationm-so2sat GEO-Bench
Overall Accuracy61.89
22
Classificationm-eurosat GEO-Bench
Overall Accuracy97.81
20
Classificationm-brick-kiln GEO-Bench
Overall Accuracy (OA)97.99
20
Segmentationm-cashew GeoBench
mIoU85.78
14
Multi-Label Classificationm-bigearthnet GeoBench
F1 Score69.93
14
Showing 6 of 6 rows

Other info

Follow for update