High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inference

09/22/2017
by   Xiaoguang Han, et al.
0

We propose a data-driven method for recovering miss-ing parts of 3D shapes. Our method is based on a new deep learning architecture consisting of two sub-networks: a global structure inference network and a local geometry refinement network. The global structure inference network incorporates a long short-term memorized context fusion module (LSTM-CF) that infers the global structure of the shape based on multi-view depth information provided as part of the input. It also includes a 3D fully convolutional (3DFCN) module that further enriches the global structure representation according to volumetric information in the input. Under the guidance of the global structure network, the local geometry refinement network takes as input lo-cal 3D patches around missing regions, and progressively produces a high-resolution, complete surface through a volumetric encoder-decoder architecture. Our method jointly trains the global structure inference and local geometry refinement networks in an end-to-end manner. We perform qualitative and quantitative evaluations on six object categories, demonstrating that our method outperforms existing state-of-the-art work on shape completion.

READ FULL TEXT

page 7

page 11

page 12

page 13

page 14

page 15

page 17

page 20

research
12/01/2016

Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis

We introduce a data-driven approach to complete partial 3D shapes throug...
research
06/01/2018

Corner-Sharing Tetrahedra for Modeling Micro-Structure

State-of-the-art representations of volumetric multi-scale shape and str...
research
06/22/2018

Video Inpainting by Jointly Learning Temporal Structure and Spatial Details

We present a new data-driven video inpainting method for recovering miss...
research
04/13/2016

VConv-DAE: Deep Volumetric Shape Learning Without Object Labels

With the advent of affordable depth sensors, 3D capture becomes more and...
research
02/12/2020

Fast Generation of High Fidelity RGB-D Images by Deep-Learning with Adaptive Convolution

Using the raw data from consumer-level RGB-D cameras as input, we propos...
research
04/05/2022

Neural Convolutional Surfaces

This work is concerned with a representation of shapes that disentangles...
research
11/17/2017

Shape Inpainting using 3D Generative Adversarial Network and Recurrent Convolutional Networks

Recent advances in convolutional neural networks have shown promising re...

Please sign up or login with your details

Forgot password? Click here to reset