Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

The Change You Want to See

About

We live in a dynamic world where things change all the time. Given two images of the same scene, being able to automatically detect the changes in them has practical applications in a variety of domains. In this paper, we tackle the change detection problem with the goal of detecting "object-level" changes in an image pair despite differences in their viewpoint and illumination. To this end, we make the following four contributions: (i) we propose a scalable methodology for obtaining a large-scale change detection training dataset by leveraging existing object segmentation benchmarks; (ii) we introduce a co-attention based novel architecture that is able to implicitly determine correspondences between an image pair and find changes in the form of bounding box predictions; (iii) we contribute four evaluation datasets that cover a variety of domains and transformations, including synthetic image changes, real surveillance images of a 3D scene, and synthetic 3D scenes with camera motion; (iv) we evaluate our model on these four datasets and demonstrate zero-shot and beyond training transformation generalization.

Ragav Sachdeva, Andrew Zisserman• 2022

Related benchmarks

TaskDatasetResultRank
Scene Change DetectionPASLCD
mIoU27.3
17
Scene Change DetectionPASLCD (test)
mIoU27.3
14
Change DetectionPASLCD Cantina 1.0 (Indoor)
mIoU27.7
6
Change DetectionPASLCD Garden Outdoor 1.0
mIoU34.6
6
Change DetectionPASLCD Zen Outdoor 1.0
mIoU45
6
Change DetectionPASLCD Porch Outdoor 1.0
mIoU43.9
6
Change DetectionPASLCD Average 1.0 (Combined)
mIoU27.3
6
Change DetectionPASLCD Lounge Indoor 1.0
mIoU22.1
6
Change DetectionPASLCD Printing Area Indoor 1.0
mIoU32.7
6
Change DetectionPASLCD Meeting Room Indoor 1.0
mIoU13.8
6
Showing 10 of 13 rows

Other info

Follow for update