The Change You Want to See

09/28/2022
by   Ragav Sachdeva, et al.
16

We live in a dynamic world where things change all the time. Given two images of the same scene, being able to automatically detect the changes in them has practical applications in a variety of domains. In this paper, we tackle the change detection problem with the goal of detecting "object-level" changes in an image pair despite differences in their viewpoint and illumination. To this end, we make the following four contributions: (i) we propose a scalable methodology for obtaining a large-scale change detection training dataset by leveraging existing object segmentation benchmarks; (ii) we introduce a co-attention based novel architecture that is able to implicitly determine correspondences between an image pair and find changes in the form of bounding box predictions; (iii) we contribute four evaluation datasets that cover a variety of domains and transformations, including synthetic image changes, real surveillance images of a 3D scene, and synthetic 3D scenes with camera motion; (iv) we evaluate our model on these four datasets and demonstrate zero-shot and beyond training transformation generalization.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
07/30/2020

Epipolar-Guided Deep Object Matching for Scene Change Detection

This paper describes a viewpoint-robust object-based change detection ne...
research
08/21/2023

The Change You Want to See (Now in 3D)

The goal of this paper is to detect what has changed, if anything, betwe...
research
01/13/2023

Learning Transformations To Reduce the Geometric Shift in Object Detection

The performance of modern object detectors drops when the test distribut...
research
03/20/2023

Zero-1-to-3: Zero-shot One Image to 3D Object

We introduce Zero-1-to-3, a framework for changing the camera viewpoint ...
research
09/06/2018

3D Surface Reconstruction by Pointillism

The objective of this work is to infer the 3D shape of an object from a ...
research
01/08/2019

Viewpoint Invariant Change Captioning

The ability to detect that something has changed in an environment is va...
research
03/09/2021

ChangeSim: Towards End-to-End Online Scene Change Detection in Industrial Indoor Environments

We present a challenging dataset, ChangeSim, aimed at online scene chang...

Please sign up or login with your details

Forgot password? Click here to reset