Meta3D: Single-View 3D Object Reconstruction from Shape Priors in Memory

03/08/2020
by   Shuo Yang, et al.
6

3D shape reconstruction from a single-view RGB image is an ill-posed problem due to the invisible parts of the object to be reconstructed. Most of the existing methods rely on large-scale data to obtain shape priors through tuning parameters of reconstruction models. These methods might not be able to deal with the cases with heavy object occlusions and noisy background since prior information can not be retained completely or applied efficiently. In this paper, we are the first to develop a memory-based meta-learning framework for single-view 3D reconstruction. A write controller is designed to extract shape-discriminative features from images and store image features and their corresponding volumes into external memory. A read controller is proposed to sequentially encode shape priors related to the input image and predict a shape-specific refiner. Experimental results demonstrate that our Meta3D outperforms state-of-the-art methods with a large margin through retaining shape priors explicitly, especially for the extremely difficult cases.

READ FULL TEXT

page 2

page 9

page 12

research
09/13/2018

Learning Shape Priors for Single-View 3D Completion and Reconstruction

The problem of single-view 3D shape completion or reconstruction is chal...
research
11/29/2018

Optimizable Object Reconstruction from a Single View

3D shape reconstruction from a single image is a highly ill-posed proble...
research
03/23/2023

SAOR: Single-View Articulated Object Reconstruction

We introduce SAOR, a novel approach for estimating the 3D shape, texture...
research
04/02/2016

3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction

Inspired by the recent success of methods that employ shape priors to ac...
research
04/14/2019

Conditional Single-view Shape Generation for Multi-view Stereo Reconstruction

In this paper, we present a new perspective towards image-based shape ge...
research
10/18/2019

Toward 3D Object Reconstruction from Stereo Images

Inferring the 3D shape of an object from an RGB image has shown impressi...
research
12/19/2020

The importance of silhouette optimization in 3D shape reconstruction system from multiple object scenes

This paper presents a multi stage 3D shape reconstruction system of mult...

Please sign up or login with your details

Forgot password? Click here to reset