Keypoint Autoencoders: Learning Interest Points of Semantics

by   Ruoxi Shi, et al.

Understanding point clouds is of great importance. Many previous methods focus on detecting salient keypoints to identity structures of point clouds. However, existing methods neglect the semantics of points selected, leading to poor performance on downstream tasks. In this paper, we propose Keypoint Autoencoder, an unsupervised learning method for detecting keypoints. We encourage selecting sparse semantic keypoints by enforcing the reconstruction from keypoints to the original point cloud. To make sparse keypoint selection differentiable, Soft Keypoint Proposal is adopted by calculating weighted averages among input points. A downstream task of classifying shape with sparse keypoints is conducted to demonstrate the distinctiveness of our selected keypoints. Semantic Accuracy and Semantic Richness are proposed and our method gives competitive or even better performance than state of the arts on these two metrics.



There are no comments yet.


page 1

page 4


Context Prediction for Unsupervised Deep Learning on Point Clouds

Point clouds provide a flexible and natural representation usable in cou...

SKD: Unsupervised Keypoint Detecting for Point Clouds using Embedded Saliency Estimation

In this work we present a novel keypoint detector that uses saliency to ...

Graphite: GRAPH-Induced feaTure Extraction for Point Cloud Registration

3D Point clouds are a rich source of information that enjoy growing popu...

Skeleton Merger: an Unsupervised Aligned Keypoint Detector

Detecting aligned 3D keypoints is essential under many scenarios such as...

USIP: Unsupervised Stable Interest Point Detection from 3D Point Clouds

In this paper, we propose the USIP detector: an Unsupervised Stable Inte...

Beyond Farthest Point Sampling in Point-Wise Analysis

Sampling, grouping, and aggregation are three important components in th...

Few-Shot Keypoint Detection as Task Adaptation via Latent Embeddings

Dense object tracking, the ability to localize specific object points wi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.