Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation

About

Reasoning segmentation aims to segment target objects described by complex language through joint visual-textual reasoning. Existing methods typically rely on either learned semantic tokens to bridge Multimodal Large Language Models (MLLMs) and segmentation models, suffering from difficult cross-modal alignment, or explicit spatial prompts such as bounding boxes, which may lose holistic response semantics. To address these limitations, we propose Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation, termed CR-Seg, a two-stage framework for coarse-to-refined reasoning segmentation. Specifically, we design an Extract Attention Maps and Points (EAP) module to extract attention maps for coarse target localization and select informative points, both of which are fed into SAM for mask refinement. To alleviate reasoning--answer inconsistency, we further introduce Global-to-Local Chain-of-Thought (GLCoT), which guides the model to reason progressively from global scene context to local target details. Extensive experiments on reasoning segmentation benchmarks demonstrate the effectiveness of CR-Seg.

Yifan Cao, Xiaocui Yang, Faxian Wan, Shi Feng, Daling Wang, Yifei Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Reasoning SegmentationReasonSeg (val)
gIoU70.8
382
Reasoning SegmentationReasonSeg (test)
gIoU64.8
287
Reasoning SegmentationFReasonSeg 1.0 (L1)
gIoU61.55
12
Reasoning SegmentationFReasonSeg 1.0 (L2)
gIoU82.7
12
Reasoning SegmentationFReasonSeg L3 1.0
gIoU80.48
12
Reasoning SegmentationFReasonSeg 1.0 (Overall)
gIoU79.85
12
Showing 6 of 6 rows

Other info

Follow for update