Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation

About

Referring Remote Sensing Image Segmentation (RRSIS) is a situated, task-driven cross-modal task related to the embodied perception paradigm, requiring models to align visual-spatial features with linguistic intentions for precise target perception. Recent research has focused on refining the granularity of textual features and optimizing image-text feature fusion to better guide target feature representations. However, insufficient descriptive granularity and sensitivity to semantic shifts can cause bottlenecks in cross-modal feature fusion. To address these issues, we propose the Image-Conditioned Instance Prompt Network (ICIPNet) with Bilateral Information Fusion, which is designed to alleviate bottlenecks in cross-modal feature fusion. ICIPNet introduces an Image-Conditioned Instance Prompt (ICIP) module to generate self-adaptive visual and semantic representations without external knowledge. The Bilateral Information Fusion (BIF) module enhances feature fusion along the token and channel dimensions. Experiments demonstrate that the proposed ICIPNet outperforms existing RRSIS models.

Biaoyu Ren, Qingsheng Wang, Cun Xu, Dingkang Yang, Wenxuan Wang (1 and 3) __INSTITUTION_5__ School of Computer Science, Northwestern Polytechnical University, Xi'an, China, (2) College of Intelligent Robotics, Advanced Manufacturing, Fudan University, Shanghai, China, (3) Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen, China)• 2026

Related benchmarks

TaskDatasetResultRank
Referring Remote Sensing Image SegmentationRRSIS-D (test)
Precision @ IoU 0.573.84
36
Referring Remote Sensing Image SegmentationRRSIS-D (val)
mIoU (Mean IoU)65.19
28
Referring Remote Sensing Image SegmentationRefSegRS (test)
Pr@0.582.39
23
Referring Remote Sensing Image SegmentationRefSegRS (val)
Pr@0.596.23
23
Showing 4 of 4 rows

Other info

Follow for update