Deep Unsupervised Learning of 3D Point Clouds via Graph Topology Inference and Filtering

05/11/2019
by   Siheng Chen, et al.
0

We propose a deep autoencoder with graph topology inference and filtering to achieve compact representations of unorganized 3D point clouds in an unsupervised manner. The encoder of the proposed networks adopts similar architectures as in PointNet, which is a well-acknowledged method for supervised learning of 3D point clouds. The decoder of the proposed networks involves three novel modules: the folding module, the graph-topology-inference module, and the graph-filtering module. The folding module folds a canonical 2D lattice to the underlying surface of a 3D point cloud, achieving coarse reconstruction; the graph-topology-inference module learns a graph topology to represent pairwise relationships between 3D points; and the graph-filtering module designs graph filters based on the learnt graph topology to obtain the refined reconstruction. We further provide theoretical analyses of the proposed architecture. We provide an upper bound for the reconstruction loss and further show the superiority of graph smoothness over spatial smoothness as a prior to model 3D point clouds. In the experiments, we validate the proposed networks in three tasks, including reconstruction, visualization, and classification. The experimental results show that (1) the proposed networks outperform the state-of-the-art methods in various tasks, including reconstruction and transfer classification; (2) a graph topology can be inferred as auxiliary information without specific supervision on graph topology inference; and (3) graph filtering refines the reconstruction, leading to better performances.

READ FULL TEXT

page 1

page 4

research
12/19/2017

FoldingNet: Interpretable Unsupervised Learning on 3D Point Clouds

Recent deep networks that directly handle points in a point set, e.g., P...
research
01/03/2019

GeoNet: Deep Geodesic Networks for Point Cloud Analysis

Surface-based geodesic topology provides strong cues for object semantic...
research
07/08/2019

Learning Structural Graph Layouts and 3D Shapes for Long Span Bridges 3D Reconstruction

A learning-based 3D reconstruction method for long-span bridges is propo...
research
10/18/2019

Unsupervised Multi-Task Feature Learning on Point Clouds

We introduce an unsupervised multi-task model to jointly learn point and...
research
12/09/2021

Progressive Seed Generation Auto-encoder for Unsupervised Point Cloud Learning

With the development of 3D scanning technologies, 3D vision tasks have b...
research
03/19/2022

Unsupervised Learning of 3D Semantic Keypoints with Mutual Reconstruction

Semantic 3D keypoints are category-level semantic consistent points on 3...
research
12/31/2021

Representation Topology Divergence: A Method for Comparing Neural Network Representations

Comparison of data representations is a complex multi-aspect problem tha...

Please sign up or login with your details

Forgot password? Click here to reset