Incremental Object Database: Building 3D Models from Multiple Partial Observations

08/02/2018
by   Fadri Furrer, et al.
0

Collecting 3D object datasets involves a large amount of manual work and is time consuming. Getting complete models of objects either requires a 3D scanner that covers all the surfaces of an object or one needs to rotate it to completely observe it. We present a system that incrementally builds a database of objects as a mobile agent traverses a scene. Our approach requires no prior knowledge of the shapes present in the scene. Object-like segments are extracted from a global segmentation map, which is built online using the input of segmented RGB-D images. These segments are stored in a database, matched among each other, and merged with other previously observed instances. This allows us to create and improve object models on the fly and to use these merged models to reconstruct also unobserved parts of the scene. The database contains each (potentially merged) object model only once, together with a set of poses where it was observed. We evaluate our pipeline with one public dataset, and on a newly created Google Tango dataset containing four indoor scenes with some of the objects appearing multiple times, both within and across scenes.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

research
11/22/2022

ONeRF: Unsupervised 3D Object Segmentation from Multiple Views

We present ONeRF, a method that automatically segments and reconstructs ...
research
09/21/2017

SceneCut: Joint Geometric and Object Segmentation for Indoor Scenes

This paper presents SceneCut, a novel approach to jointly discover previ...
research
03/24/2022

Object Memory Transformer for Object Goal Navigation

This paper presents a reinforcement learning method for object goal navi...
research
04/09/2015

Predicting Complete 3D Models of Indoor Scenes

One major goal of vision is to infer physical models of objects, surface...
research
02/28/2017

SceneSeer: 3D Scene Design with Natural Language

Designing 3D scenes is currently a creative task that requires significa...
research
11/29/2018

Incremental Scene Synthesis

We present a method to incrementally generate complete 2D or 3D scenes w...
research
10/17/2017

3D Object Discovery and Modeling Using Single RGB-D Images Containing Multiple Object Instances

Unsupervised object modeling is important in robotics, especially for ha...

Please sign up or login with your details

Forgot password? Click here to reset