Variational Relational Point Completion Network

04/20/2021
by   Liang Pan, et al.
0

Real-scanned point clouds are often incomplete due to viewpoint, occlusion, and noise. Existing point cloud completion methods tend to generate global shape skeletons and hence lack fine local details. Furthermore, they mostly learn a deterministic partial-to-complete mapping, but overlook structural relations in man-made objects. To tackle these challenges, this paper proposes a variational framework, Variational Relational point Completion network (VRCNet) with two appealing properties: 1) Probabilistic Modeling. In particular, we propose a dual-path architecture to enable principled probabilistic modeling across partial and complete clouds. One path consumes complete point clouds for reconstruction by learning a point VAE. The other path generates complete shapes for partial point clouds, whose embedded distribution is guided by distribution obtained from the reconstruction path during training. 2) Relational Enhancement. Specifically, we carefully design point self-attention kernel and point selective kernel module to exploit relational point features, which refines local shape details conditioned on the coarse completion. In addition, we contribute a multi-view partial point cloud dataset (MVP dataset) containing over 100,000 high-quality scans, which renders partial 3D shapes from 26 uniformly distributed camera poses for each 3D CAD model. Extensive experiments demonstrate that VRCNet outperforms state-of-theart methods on all standard point cloud completion benchmarks. Notably, VRCNet shows great generalizability and robustness on real-world point cloud scans.

READ FULL TEXT

page 4

page 8

page 12

12/22/2021

Multi-View Partial (MVP) Point Cloud Challenge 2021 on Completion and Registration: Methods and Results

As real-scanned point clouds are mostly partial due to occlusions and vi...
04/08/2021

3D Shape Generation and Completion through Point-Voxel Diffusion

We propose a novel approach for probabilistic generative modeling of 3D ...
09/05/2022

Prototype-Aware Heterogeneous Task for Point Cloud Completion

Point cloud completion, which aims at recovering original shape informat...
12/07/2021

A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion

3D point cloud is an important 3D representation for capturing real worl...
10/17/2020

A Self-supervised Cascaded Refinement Network for Point Cloud Completion

Point clouds are often sparse and incomplete, which imposes difficulties...
01/20/2022

GASCN: Graph Attention Shape Completion Network

Shape completion, the problem of inferring the complete geometry of an o...
04/20/2022

Reconstruction-Aware Prior Distillation for Semi-supervised Point Cloud Completion

Point clouds scanned by real-world sensors are always incomplete, irregu...

Code Repositories

VRCNet

[CVPR 2021 Oral] Variational Relational Point Completion Network


view repo