Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction

03/24/2020
by   Rohan Chabra, et al.
10

Efficiently reconstructing complex and intricate surfaces at scale is a long-standing goal in machine perception. To address this problem we introduce Deep Local Shapes (DeepLS), a deep shape representation that enables encoding and reconstruction of high-quality 3D shapes without prohibitive memory requirements. DeepLS replaces the dense volumetric signed distance function (SDF) representation used in traditional surface reconstruction systems with a set of locally learned continuous SDFs defined by a neural network, inspired by recent work such as DeepSDF. Unlike DeepSDF, which represents an object-level SDF with a neural network and a single latent code, we store a grid of independent latent codes, each responsible for storing information about surfaces in a small local neighborhood. This decomposition of scenes into local shapes simplifies the prior distribution that the network must learn, and also enables efficient inference. We demonstrate the effectiveness and generalization power of DeepLS by showing object shape encoding and reconstructions of full scenes, where DeepLS delivers high compression, accuracy, and local shape completion.

READ FULL TEXT

page 2

page 4

page 6

page 9

page 10

page 15

page 16

page 17

research
03/19/2020

Local Implicit Grid Representations for 3D Scenes

Shape priors learned from data are commonly used to reconstruct 3D objec...
research
08/19/2021

3D Shapes Local Geometry Codes Learning with SDF

A signed distance function (SDF) as the 3D shape description is one of t...
research
06/21/2022

Deep Active Latent Surfaces for Medical Geometries

Shape priors have long been known to be effective when reconstructing 3D...
research
01/16/2019

DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation

Computer graphics, 3D computer vision and robotics communities have prod...
research
03/26/2022

Learning Deep Implicit Functions for 3D Shapes with Dynamic Code Clouds

Deep Implicit Function (DIF) has gained popularity as an efficient 3D sh...
research
03/17/2022

AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation

Powerful priors allow us to perform inference with insufficient informat...
research
01/19/2022

High-fidelity 3D Model Compression based on Key Spheres

In recent years, neural signed distance function (SDF) has become one of...

Please sign up or login with your details

Forgot password? Click here to reset