Unsupervised Learning of 3D Semantic Keypoints with Mutual Reconstruction

03/19/2022
by   Haocheng Yuan, et al.
4

Semantic 3D keypoints are category-level semantic consistent points on 3D objects. Detecting 3D semantic keypoints is a foundation for a number of 3D vision tasks but remains challenging, due to the ambiguity of semantic information, especially when the objects are represented by unordered 3D point clouds. Existing unsupervised methods tend to generate category-level keypoints in implicit manners, making it difficult to extract high-level information, such as semantic labels and topology. From a novel mutual reconstruction perspective, we present an unsupervised method to generate consistent semantic keypoints from point clouds explicitly. To achieve this, the proposed model predicts keypoints that not only reconstruct the object itself but also reconstruct other instances in the same category. To the best of our knowledge, the proposed method is the first to mine 3D semantic consistent keypoints from a mutual reconstruction view. Experiments under various evaluation metrics as well as comparisons with the state-of-the-arts demonstrate the efficacy of our new solution to mining semantic consistent keypoints with mutual reconstruction.

READ FULL TEXT
research
03/17/2020

Unsupervised Learning of Category-Specific Symmetric 3D Keypoints from Point Sets

Automatic discovery of category-specific 3D keypoints from a collection ...
research
09/07/2023

SimNP: Learning Self-Similarity Priors Between Neural Points

Existing neural field representations for 3D object reconstruction eithe...
research
05/17/2021

StrobeNet: Category-Level Multiview Reconstruction of Articulated Objects

We present StrobeNet, a method for category-level 3D reconstruction of a...
research
08/11/2020

Keypoint Autoencoders: Learning Interest Points of Semantics

Understanding point clouds is of great importance. Many previous methods...
research
05/11/2019

Deep Unsupervised Learning of 3D Point Clouds via Graph Topology Inference and Filtering

We propose a deep autoencoder with graph topology inference and filterin...
research
03/30/2018

SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters

Deep neural networks have enjoyed remarkable success for various vision ...
research
06/03/2022

SNAKE: Shape-aware Neural 3D Keypoint Field

Detecting 3D keypoints from point clouds is important for shape reconstr...

Please sign up or login with your details

Forgot password? Click here to reset