Deep Learned Full-3D Object Completion from Single View

08/21/2018
by   Dario Rethage, et al.
0

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep convolutional neural network architecture with an auto-encoder. A data set of synthetic depth views and voxelized 3D representations is built based on ModelNet, a large-scale collection of CAD models, to train networks. The proposed method offers a significant advantage over current, explicit reconstruction methods in that it learns key geometric features offline and makes use of those to predict the most probable reconstruction of an unseen object. The relatively small network, consisting of roughly 4 million weights, achieves a 92.9 use of a pre-trained decompression layer. This is roughly 1/4 the weights of the current leading network. The fast execution time of the model makes it suitable for real-time applications.

READ FULL TEXT
research
10/26/2020

SCFusion: Real-time Incremental Scene Reconstruction with Semantic Completion

Real-time scene reconstruction from depth data inevitably suffers from o...
research
03/16/2016

Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue

A significant weakness of most current deep Convolutional Neural Network...
research
08/10/2023

FrozenRecon: Pose-free 3D Scene Reconstruction with Frozen Depth Models

3D scene reconstruction is a long-standing vision task. Existing approac...
research
01/22/2020

Learning to Correct 3D Reconstructions from Multiple Views

This paper is about reducing the cost of building good large-scale 3D re...
research
01/07/2019

NVS Machines: Learning Novel View Synthesis with Fine-grained View Control

We present an approach that learns to synthesize high-quality, novel vie...
research
09/06/2022

Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawings

In this paper, we revisit the long-standing problem of automatic reconst...
research
11/03/2018

Geometry-Aware Recurrent Neural Networks for Active Visual Recognition

We present recurrent geometry-aware neural networks that integrate visua...

Please sign up or login with your details

Forgot password? Click here to reset