Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Beyond Weight Adaptation: Feature-Space Domain Injection for Cross-Modal Ship Re-Identification

About

Cross-Modality Ship Re-Identification (CMS Re-ID) is critical for achieving all-day and all-weather maritime target tracking, yet it is fundamentally challenged by significant modality discrepancies. Mainstream solutions typically rely on explicit modality alignment strategies; however, this paradigm heavily depends on constructing large-scale paired datasets for pre-training. To address this, grounded in the Platonic Representation Hypothesis, we explore the potential of Vision Foundation Models (VFMs) in bridging modality gaps. Recognizing the suboptimal performance of existing generic Parameter-Efficient Fine-Tuning (PEFT) methods that operate within the weight space, particularly on limited-capacity models, we shift the optimization perspective to the feature space and propose a novel PEFT strategy termed Domain Representation Injection (DRI). Specifically, while keeping the VFM fully frozen to maximize the preservation of general knowledge, we design a lightweight, learnable Offset Encoder to extract domain-specific representations rich in modality and identity attributes from raw inputs. Guided by the contextual information of intermediate features at different layers, a Modulator adaptively transforms these representations. Subsequently, they are injected into the intermediate layers via additive fusion, dynamically reshaping the feature distribution to adapt to the downstream task without altering the VFM's pre-trained weights. Extensive experimental results demonstrate the superiority of our method, achieving State-of-the-Art (SOTA) performance with minimal trainable parameters. For instance, on the HOSS-ReID dataset, we attain 57.9\% and 60.5\% mAP using only 1.54M and 7.05M parameters, respectively. The code is available at https://github.com/TingfengXian/DRI.

Tingfeng Xian, Wenlve Zhou, Zhiheng Zhou, Zhelin Li• 2025

Related benchmarks

TaskDatasetResultRank
Ship Re-identificationHOSS-ReID Optical to SAR
mAP55.6
35
Ship Re-identificationHOSS-ReID SAR to Optical
mAP46.1
35
Ship Re-identificationHOSS-ReID (All)
mAP60.5
19
Cross-modal Ship Re-identificationCMShipReID TIR to VIS
mAP84.1
13
Cross-modal Ship Re-identificationCMShipReID VIS to TIR
mAP84.9
13
Cross-modal Ship Re-identificationCMShipReID NIR to VIS
mAP72.6
13
Ship Re-identificationCMShipReID NIR to TIR Part II
mAP67.5
13
Ship Re-identificationCMShipReID TIR to NIR Part II
mAP64.3
13
Ship Re-identificationCMShipReID VIS to NIR Part II
mAP71.8
13
Showing 9 of 9 rows

Other info

Follow for update