SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generator

by   Zhe Zhu, et al.

In this paper, we propose a novel network, SVDFormer, to tackle two specific challenges in point cloud completion: understanding faithful global shapes from incomplete point clouds and generating high-accuracy local structures. Current methods either perceive shape patterns using only 3D coordinates or import extra images with well-calibrated intrinsic parameters to guide the geometry estimation of the missing parts. However, these approaches do not always fully leverage the cross-modal self-structures available for accurate and high-quality point cloud completion. To this end, we first design a Self-view Fusion Network that leverages multiple-view depth image information to observe incomplete self-shape and generate a compact global shape. To reveal highly detailed structures, we then introduce a refinement module, called Self-structure Dual-generator, in which we incorporate learned shape priors and geometric self-similarities for producing new points. By perceiving the incompleteness of each point, the dual-path design disentangles refinement strategies conditioned on the structural type of each point. SVDFormer absorbs the wisdom of self-structures, avoiding any additional paired information such as color images with precisely calibrated camera intrinsic parameters. Comprehensive experiments indicate that our method achieves state-of-the-art performance on widely-used benchmarks. Code will be available at


page 1

page 3

page 7

page 8

page 12

page 14

page 15

page 16


CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completion

How will you repair a physical object with some missings? You may imagin...

Unsupervised Learning of Intrinsic Structural Representation Points

Learning structures of 3D shapes is a fundamental problem in the field o...

Style-based Point Generator with Adversarial Rendering for Point Cloud Completion

In this paper, we proposed a novel Style-based Point Generator with Adve...

Cascaded Refinement Network for Point Cloud Completion

Point clouds are often sparse and incomplete. Existing shape completion ...

SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer

Point cloud completion aims to predict a complete shape in high accuracy...

Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completion

Chamfer Distance (CD) and Earth Mover's Distance (EMD) are two broadly a...

Spotlights: Probing Shapes from Spherical Viewpoints

Recent years have witnessed the surge of learned representations that di...

Please sign up or login with your details

Forgot password? Click here to reset