Convolutional Occupancy Networks

03/10/2020
by   Songyou Peng, et al.
12

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction. While demonstrating promising results, most implicit approaches are limited to comparably simple geometry of single objects and do not scale to more complicated or large-scale scenes. The key limiting factor of implicit methods is their simple fully-connected network architecture which does not allow for integrating local information in the observations or incorporating inductive biases such as translational equivariance. In this paper, we propose Convolutional Occupancy Networks, a more flexible implicit representation for detailed reconstruction of objects and 3D scenes. By combining convolutional encoders with implicit occupancy decoders, our model incorporates inductive biases and Manhattan-world priors, enabling structured reasoning in 3D space. We investigate the effectiveness of the proposed representation by reconstructing complex geometry from noisy point clouds and low-resolution voxel representations. We empirically find that our method enables fine-grained implicit 3D reconstruction of single objects, scales to large indoor scenes and generalizes well from synthetic to real data.

READ FULL TEXT

page 2

page 10

page 13

page 14

research
11/11/2020

Dynamic Plane Convolutional Occupancy Networks

Learning-based 3D reconstruction using implicit neural representations h...
research
06/01/2022

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction

In recent years, neural implicit surface reconstruction methods have bec...
research
02/28/2023

Efficient Implicit Neural Reconstruction Using LiDAR

Modeling scene geometry using implicit neural representation has reveale...
research
06/27/2020

On the generalization of learning-based 3D reconstruction

State-of-the-art learning-based monocular 3D reconstruction methods lear...
research
12/10/2018

Occupancy Networks: Learning 3D Reconstruction in Function Space

With the advent of deep neural networks, learning-based approaches for 3...
research
03/19/2020

Local Implicit Grid Representations for 3D Scenes

Shape priors learned from data are commonly used to reconstruct 3D objec...
research
08/29/2023

DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstruction

In recent years, the neural implicit surface has emerged as a powerful r...

Please sign up or login with your details

Forgot password? Click here to reset