The Change You Want to See
About
We live in a dynamic world where things change all the time. Given two images of the same scene, being able to automatically detect the changes in them has practical applications in a variety of domains. In this paper, we tackle the change detection problem with the goal of detecting "object-level" changes in an image pair despite differences in their viewpoint and illumination. To this end, we make the following four contributions: (i) we propose a scalable methodology for obtaining a large-scale change detection training dataset by leveraging existing object segmentation benchmarks; (ii) we introduce a co-attention based novel architecture that is able to implicitly determine correspondences between an image pair and find changes in the form of bounding box predictions; (iii) we contribute four evaluation datasets that cover a variety of domains and transformations, including synthetic image changes, real surveillance images of a 3D scene, and synthetic 3D scenes with camera motion; (iv) we evaluate our model on these four datasets and demonstrate zero-shot and beyond training transformation generalization.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Scene Change Detection | PASLCD (test) | mIoU27.3 | 14 | |
| Change Detection | PASLCD Cantina 1.0 (Indoor) | mIoU27.7 | 6 | |
| Change Detection | PASLCD Garden Outdoor 1.0 | mIoU34.6 | 6 | |
| Change Detection | PASLCD Zen Outdoor 1.0 | mIoU45 | 6 | |
| Change Detection | PASLCD Porch Outdoor 1.0 | mIoU43.9 | 6 | |
| Change Detection | PASLCD Average 1.0 (Combined) | mIoU27.3 | 6 | |
| Change Detection | PASLCD Lounge Indoor 1.0 | mIoU22.1 | 6 | |
| Change Detection | PASLCD Printing Area Indoor 1.0 | mIoU32.7 | 6 | |
| Change Detection | PASLCD Meeting Room Indoor 1.0 | mIoU13.8 | 6 | |
| Change Detection | PASLCD Pots Outdoor 1.0 | mIoU0.351 | 6 |