DynamicEarth: How Far are We from Open-Vocabulary Change Detection?
About
Monitoring Earth's evolving land covers requires methods capable of detecting changes across a wide range of categories and contexts. Existing change detection methods are hindered by their dependency on predefined classes, reducing their effectiveness in open-world applications. To address this issue, we introduce open-vocabulary change detection (OVCD), a novel task that bridges vision and language to detect changes across any category. Considering the lack of high-quality data and annotation, we propose two training-free frameworks, M-C-I and I-M-C, which leverage and integrate off-the-shelf foundation models for the OVCD task. The insight behind the M-C-I framework is to discover all potential changes and then classify these changes, while the insight of I-M-C framework is to identify all targets of interest and then determine whether their states have changed. Based on these two frameworks, we instantiate to obtain several methods, e.g., SAM-DINOv2-SegEarth-OV, Grounding-DINO-SAM2-DINO, etc. Extensive evaluations on 5 benchmark datasets demonstrate the superior generalization and robustness of our OVCD methods over existing supervised and unsupervised methods. To support continued exploration, we release DynamicEarth, a dedicated codebase designed to advance research and application of OVCD. https://likyoo.github.io/DynamicEarth
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Change Detection | LEVIR-CD (test) | F1 Score69.7 | 357 | |
| Change Detection | LEVIR-CD | F1 Score69.7 | 188 | |
| Change Detection | S2Looking (test) | F1 Score38.5 | 69 | |
| Change Detection | WHU-CD | mIoU61.1 | 55 | |
| Change Detection | Avg across SYSU, LEVIR, GVLM, CLCD, OSCD | Precision34.9 | 23 | |
| Building Change Detection | WHU-CD (test) | IoU (Changed)55.2 | 17 | |
| Unsupervised Change Detection | LEVIR | F1 Score49.5 | 12 | |
| Building Change Detection | DSIFN 1.0 (test) | Precision58.52 | 12 | |
| Unsupervised Change Detection | SYSU | F1 Score60.3 | 12 | |
| Building Change Detection | LEVIR-CD 1.0 (test) | Precision62.15 | 12 |