Keypoint Autoencoders: Learning Interest Points of Semantics

08/11/2020
by   Ruoxi Shi, et al.
0

Understanding point clouds is of great importance. Many previous methods focus on detecting salient keypoints to identity structures of point clouds. However, existing methods neglect the semantics of points selected, leading to poor performance on downstream tasks. In this paper, we propose Keypoint Autoencoder, an unsupervised learning method for detecting keypoints. We encourage selecting sparse semantic keypoints by enforcing the reconstruction from keypoints to the original point cloud. To make sparse keypoint selection differentiable, Soft Keypoint Proposal is adopted by calculating weighted averages among input points. A downstream task of classifying shape with sparse keypoints is conducted to demonstrate the distinctiveness of our selected keypoints. Semantic Accuracy and Semantic Richness are proposed and our method gives competitive or even better performance than state of the arts on these two metrics.

READ FULL TEXT

page 1

page 4

research
01/24/2019

Context Prediction for Unsupervised Deep Learning on Point Clouds

Point clouds provide a flexible and natural representation usable in cou...
research
06/03/2022

SNAKE: Shape-aware Neural 3D Keypoint Field

Detecting 3D keypoints from point clouds is important for shape reconstr...
research
06/16/2022

TUSK: Task-Agnostic Unsupervised Keypoints

Existing unsupervised methods for keypoint learning rely heavily on the ...
research
10/11/2022

APSNet: Attention Based Point Cloud Sampling

Processing large point clouds is a challenging task. Therefore, the data...
research
03/19/2022

Unsupervised Learning of 3D Semantic Keypoints with Mutual Reconstruction

Semantic 3D keypoints are category-level semantic consistent points on 3...
research
11/16/2022

Semantic keypoint extraction for scanned animals using multi-depth-camera systems

Keypoint annotation in point clouds is an important task for 3D reconstr...
research
03/19/2021

Skeleton Merger: an Unsupervised Aligned Keypoint Detector

Detecting aligned 3D keypoints is essential under many scenarios such as...

Please sign up or login with your details

Forgot password? Click here to reset