Secrets of 3D Implicit Object Shape Reconstruction in the Wild

01/18/2021
by   Shivam Duggal, et al.
28

Reconstructing high-fidelity 3D objects from sparse, partial observation is of crucial importance for various applications in computer vision, robotics, and graphics. While recent neural implicit modeling methods show promising results on synthetic or dense datasets, they perform poorly on real-world data that is sparse and noisy. This paper analyzes the root cause of such deficient performance of a popular neural implicit model. We discover that the limitations are due to highly complicated objectives, lack of regularization, and poor initialization. To overcome these issues, we introduce two simple yet effective modifications: (i) a deep encoder that provides a better and more stable initialization for latent code optimization; and (ii) a deep discriminator that serves as a prior model to boost the fidelity of the shape. We evaluate our approach on two real-wold self-driving datasets and show superior performance over state-of-the-art 3D object reconstruction methods.

READ FULL TEXT

page 1

page 3

page 6

page 8

page 16

page 17

page 18

page 19

research
09/12/2021

Multiresolution Deep Implicit Functions for 3D Shape Representation

We introduce Multiresolution Deep Implicit Functions (MDIF), a hierarchi...
research
02/24/2023

3D Surface Reconstruction in the Wild by Deforming Shape Priors from Synthetic Data

Reconstructing the underlying 3D surface of an object from a single imag...
research
04/08/2023

High-Fidelity Clothed Avatar Reconstruction from a Single Image

This paper presents a framework for efficient 3D clothed avatar reconstr...
research
08/18/2022

LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling

Recent progress in 4D implicit representation focuses on globally contro...
research
07/22/2021

Pose Estimation and 3D Reconstruction of Vehicles from Stereo-Images Using a Subcategory-Aware Shape Prior

The 3D reconstruction of objects is a prerequisite for many highly relev...
research
01/19/2022

High-fidelity 3D Model Compression based on Key Spheres

In recent years, neural signed distance function (SDF) has become one of...
research
02/16/2018

Real-Time 3D Shape of Micro-Details

Motivated by the growing demand for interactive environments, we propose...

Please sign up or login with your details

Forgot password? Click here to reset