3D Reconstruction of Novel Object Shapes from Single Images

06/14/2020
by   Anh Thai, et al.
47

The key challenge in single image 3D shape reconstruction is to ensure that deep models can generalize to shapes which were not part of the training set. This is difficult because the algorithm must infer the occluded portion of the surface by leveraging the shape characteristics of the training data, and can therefore be vulnerable to overfitting. Such generalization to unseen categories of objects is a function of architecture design and training approaches. This paper introduces SDFNet, a novel shape prediction architecture and training approach which supports effective generalization. We provide an extensive investigation of the factors which influence generalization accuracy and its measurement, ranging from the consistent use of 3D shape metrics to the choice of rendering approach and the large-scale evaluation on unseen shapes using ShapeNetCore.v2 and ABC. We show that SDFNet provides state-of-the-art performance on seen and unseen shapes relative to existing baseline methods GenRe and OccNet. We provide the first large-scale experimental evaluation of generalization performance. The codebase released with this article will allow for the consistent evaluation and comparison of methods for single image shape reconstruction.

READ FULL TEXT

page 4

page 7

page 9

page 10

page 11

page 16

research
04/12/2018

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling

We study 3D shape modeling from a single image and make contributions to...
research
10/16/2020

Training Data Generating Networks: Linking 3D Shapes and Few-Shot Classification

We propose a novel 3d shape representation for 3d shape reconstruction f...
research
12/04/2020

Compositionally Generalizable 3D Structure Prediction

Single-image 3D shape reconstruction is an important and long-standing p...
research
04/29/2018

Matryoshka Networks: Predicting 3D Geometry via Nested Shape Layers

In this paper, we develop novel, efficient 2D encodings for 3D geometry,...
research
06/18/2016

Automatic 3D Reconstruction for Symmetric Shapes

Generic 3D reconstruction from a single image is a difficult problem. A ...
research
11/30/2021

A Dataset-Dispersion Perspective on Reconstruction Versus Recognition in Single-View 3D Reconstruction Networks

Neural networks (NN) for single-view 3D reconstruction (SVR) have gained...
research
10/17/2017

Large-Scale 3D Shape Reconstruction and Segmentation from ShapeNet Core55

We introduce a large-scale 3D shape understanding benchmark using data a...

Please sign up or login with your details

Forgot password? Click here to reset