Objects Can Move: 3D Change Detection by Geometric Transformation Constistency

08/21/2022
by   Aikaterini Adam, et al.
0

AR/VR applications and robots need to know when the scene has changed. An example is when objects are moved, added, or removed from the scene. We propose a 3D object discovery method that is based only on scene changes. Our method does not need to encode any assumptions about what is an object, but rather discovers objects by exploiting their coherent move. Changes are initially detected as differences in the depth maps and segmented as objects if they undergo rigid motions. A graph cut optimization propagates the changing labels to geometrically consistent regions. Experiments show that our method achieves state-of-the-art performance on the 3RScan dataset against competitive baselines. The source code of our method can be found at https://github.com/katadam/ObjectsCanMove.

READ FULL TEXT

page 21

page 23

page 28

research
03/04/2023

Exploiting Implicit Rigidity Constraints via Weight-Sharing Aggregation for Scene Flow Estimation from Point Clouds

Scene flow estimation, which predicts the 3D motion of scene points from...
research
01/11/2021

Learning to Segment Rigid Motions from Two Frames

Appearance-based detectors achieve remarkable performance on common scen...
research
07/18/2023

Object-aware Gaze Target Detection

Gaze target detection aims to predict the image location where the perso...
research
09/06/2021

Learning to Generate Scene Graph from Natural Language Supervision

Learning from image-text data has demonstrated recent success for many r...
research
04/09/2020

Where Does It End? – Reasoning About Hidden Surfaces by Object Intersection Constraints

Dynamic scene understanding is an essential capability in robotics and V...
research
11/24/2022

One-Shot General Object Localization

This paper presents a general one-shot object localization algorithm cal...
research
06/29/2021

RICE: Refining Instance Masks in Cluttered Environments with Graph Neural Networks

Segmenting unseen object instances in cluttered environments is an impor...

Please sign up or login with your details

Forgot password? Click here to reset