Where Does It End? – Reasoning About Hidden Surfaces by Object Intersection Constraints

04/09/2020
by   Michael Strecke, et al.
0

Dynamic scene understanding is an essential capability in robotics and VR/AR. In this paper we propose Co-Section, an optimization-based approach to 3D dynamic scene reconstruction, which infers hidden shape information from intersection constraints. An object-level dynamic SLAM frontend detects, segments, tracks and maps dynamic objects in the scene. Our optimization backend completes the shapes using hull and intersection constraints between the objects. In experiments, we demonstrate our approach on real and synthetic dynamic scene datasets. We also assess the shape completion performance of our method quantitatively. To the best of our knowledge, our approach is the first method to incorporate such physical plausibility constraints on object intersections for shape completion of dynamic objects in an energy minimization framework.

READ FULL TEXT

page 1

page 4

page 7

page 8

research
11/30/2021

DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapes

Differentiable physics is a powerful tool in computer vision and robotic...
research
04/27/2015

Dynamic Body VSLAM with Semantic Constraints

Image based reconstruction of urban environments is a challenging proble...
research
03/07/2022

Human-Aware Object Placement for Visual Environment Reconstruction

Humans are in constant contact with the world as they move through it an...
research
02/03/2023

vMAP: Vectorised Object Mapping for Neural Field SLAM

We present vMAP, an object-level dense SLAM system using neural field re...
research
06/20/2017

Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objects

In this paper we introduce Co-Fusion, a dense SLAM system that takes a l...
research
08/21/2022

Objects Can Move: 3D Change Detection by Geometric Transformation Constistency

AR/VR applications and robots need to know when the scene has changed. A...
research
10/27/2018

Flash Photography for Data-Driven Hidden Scene Recovery

Vehicles, search and rescue personnel, and endoscopes use flash lights t...

Please sign up or login with your details

Forgot password? Click here to reset