Seg2Change: Adapting Open-Vocabulary Semantic Segmentation Model for Remote Sensing Change Detection
About
Change detection is a fundamental task in remote sensing, aiming to quantify the impacts of human activities and ecological dynamics on land-cover changes. Existing change detection methods are limited to predefined classes in training datasets, which constrains their scalability in real-world scenarios. In recent years, numerous advanced open-vocabulary semantic segmentation models have emerged for remote sensing imagery. However, there is still a lack of an effective framework for directly applying these models to open-vocabulary change detection (OVCD), a novel task that integrates vision and language to detect changes across arbitrary categories. To address these challenges, we first construct a category-agnostic change detection dataset, termed CA-CDD. Further, we design a category-agnostic change head to detect the transitions of arbitrary categories and index them to specific classes. Based on them, we propose Seg2Change, an adapter designed to adapt open-vocabulary semantic segmentation models to change detection task. Without bells and whistles, this simple yet effective framework achieves state-of-the-art OVCD performance (+9.52 IoU on WHU-CD and +5.50 mIoU on SECOND). Our code is released at https://github.com/yogurts-sy/Seg2Change.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Change Detection | LEVIR-CD | F1 Score78.72 | 232 | |
| Change Detection | WHU-CD | IoU75.72 | 202 | |
| Remote Sensing Change Detection | CLCD | F1 Score47.89 | 44 | |
| Land Cover Change Detection | DSIFN | F1 Score58.56 | 12 | |
| Open-vocabulary change detection | WHU-CD | F1 Score0.8618 | 12 | |
| Open-vocabulary change detection | LEVIR-CD | F1 Score78.72 | 12 | |
| Open-vocabulary change detection | DSIFN | F1 Score58.56 | 12 | |
| Open-vocabulary change detection | CLCD | F1 Score47.89 | 12 | |
| Semantic Change Detection | SC-SCD (test) | mF135.68 | 9 |