Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification

About

Despite significant progress in multi-modal Re-Identification (ReID), existing methods tend to emphasize low-frequency cues. Consequently, they focus on attributes such as color, illumination, and coarse appearance, while overlooking mid and high-frequency structures that encode geometric, textural, and identity-discriminative details. This imbalance leads to incomplete spectral representations and unstable cross-modal alignment. To overcome these limitations, we introduce FUSE, a frequency-domain framework that reformulates multi-modal ReID as a two-stage process of spectral disentanglement and energy alignment. The proposed Spectral Decomposition Module (SDM) adaptively partitions features into low, mid, and high-frequency subspaces, enabling hierarchical spectral modeling. The Cross-Modal Alignment Module (CAM) further enforces energy alignment and subspace complementarity across modalities via frequency-consistency regularization. In addition, FUSE incorporates learnable frequency modulation to enhance robustness under varying illumination and heterogeneous sensor conditions. Extensive experiments on RGBNT201, RGBNT100, and MSVR310 show that FUSE achieves 9.1\% mAP and 9.5\% Rank-1 improvements, establishing an interpretable frequency-domain paradigm for multi-modal representation learning.

Xuanhao Qi, Tom H. Luan, Yukang Zhang, Jinkai Zheng, Zhou Su, Shuwei Li, Lei Tan• 2026

Related benchmarks

TaskDatasetResultRank
Re-identificationRGBNT201
mAP81.4
61
Multi-modal Vehicle Re-IdentificationMSVR310 (test)
mAP50.1
35
Multi-modal Vehicle Re-IdentificationRGBNT100
mAP88.5
26
Multi-modal Object Re-IdentificationRGBNT201
mAP (NIR)70.9
11
Object Re-identificationRGBNT201 (missing-modality)
mAP49.9
3
Showing 5 of 5 rows

Other info

Follow for update