DeepAI AI Chat
Log In Sign Up

Joint Data and Feature Augmentation for Self-Supervised Representation Learning on Point Clouds

by   Zhuheng Lu, et al.
Nanjing University

To deal with the exhausting annotations, self-supervised representation learning from unlabeled point clouds has drawn much attention, especially centered on augmentation-based contrastive methods. However, specific augmentations hardly produce sufficient transferability to high-level tasks on different datasets. Besides, augmentations on point clouds may also change underlying semantics. To address the issues, we propose a simple but efficient augmentation fusion contrastive learning framework to combine data augmentations in Euclidean space and feature augmentations in feature space. In particular, we propose a data augmentation method based on sampling and graph generation. Meanwhile, we design a data augmentation network to enable a correspondence of representations by maximizing consistency between augmented graph pairs. We further design a feature augmentation network that encourages the model to learn representations invariant to the perturbations using an encoder perturbation. We comprehensively conduct extensive object classification experiments and object part segmentation experiments to validate the transferability of the proposed framework. Experimental results demonstrate that the proposed framework is effective to learn the point cloud representation in a self-supervised manner, and yields state-of-the-art results in the community. The source code is publicly available at:


page 3

page 7


CLR-GAM: Contrastive Point Cloud Learning with Guided Augmentation and Feature Mapping

Point cloud data plays an essential role in robotics and self-driving ap...

Self-Supervised Visual Place Recognition by Mining Temporal and Feature Neighborhoods

Visual place recognition (VPR) using deep networks has achieved state-of...

Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds

To date, various 3D scene understanding tasks still lack practical and g...

SanitAIs: Unsupervised Data Augmentation to Sanitize Trojaned Neural Networks

The application of self-supervised methods has resulted in broad improve...

Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understanding

Unsupervised learning on 3D point clouds has undergone a rapid evolution...

Contrastive Self-Supervised Learning for Skeleton Representations

Human skeleton point clouds are commonly used to automatically classify ...

Color Variants Identification via Contrastive Self-Supervised Representation Learning

In this paper, we utilize deep visual Representation Learning to address...