Multiresolution Deep Implicit Functions for 3D Shape Representation

09/12/2021
by   Zhang Chen, et al.
8

We introduce Multiresolution Deep Implicit Functions (MDIF), a hierarchical representation that can recover fine geometry detail, while being able to perform global operations such as shape completion. Our model represents a complex 3D shape with a hierarchy of latent grids, which can be decoded into different levels of detail and also achieve better accuracy. For shape completion, we propose latent grid dropout to simulate partial data in the latent space and therefore defer the completing functionality to the decoder side. This along with our multires design significantly improves the shape completion quality under decoder-only latent optimization. To the best of our knowledge, MDIF is the first deep implicit function model that can at the same time (1) represent different levels of detail and allow progressive decoding; (2) support both encoder-decoder inference and decoder-only latent optimization, and fulfill multiple applications; (3) perform detailed decoder-only shape completion. Experiments demonstrate its superior performance against prior art in various 3D reconstruction tasks.

READ FULL TEXT

page 7

page 10

page 11

page 12

page 15

page 16

page 17

page 18

research
12/12/2022

ROAD: Learning an Implicit Recursive Octree Auto-Decoder to Efficiently Encode 3D Shapes

Compact and accurate representations of 3D shapes are central to many pe...
research
01/18/2021

Secrets of 3D Implicit Object Shape Reconstruction in the Wild

Reconstructing high-fidelity 3D objects from sparse, partial observation...
research
03/14/2022

Can A Neural Network Hear the Shape of A Drum?

We have developed a deep neural network that reconstructs the shape of a...
research
09/21/2018

Adaptive O-CNN: A Patch-based Deep Representation of 3D Shapes

We present an Adaptive Octree-based Convolutional Neural Network (Adapti...
research
03/15/2021

Learning Compositional Representation for 4D Captures with Neural ODE

Learning based representation has become the key to the success of many ...
research
01/25/2022

ShapeFormer: Transformer-based Shape Completion via Sparse Representation

We present ShapeFormer, a transformer-based network that produces a dist...
research
09/09/2022

Towards Confidence-guided Shape Completion for Robotic Applications

Many robotic tasks involving some form of 3D visual perception greatly b...

Please sign up or login with your details

Forgot password? Click here to reset