Improving Semantic Analysis on Point Clouds via Auxiliary Supervision of Local Geometric Priors

01/14/2020
by   Lulu Tang, et al.
62

Existing deep learning algorithms for point cloud analysis mainly concern discovering semantic patterns from global configuration of local geometries in a supervised learning manner. However, very few explore geometric properties revealing local surface manifolds embedded in 3D Euclidean space to discriminate semantic classes or object parts as additional supervision signals. This paper is the first attempt to propose a unique multi-task geometric learning network to improve semantic analysis by auxiliary geometric learning with local shape properties, which can be either generated via physical computation from point clouds themselves as self-supervision signals or provided as privileged information. Owing to explicitly encoding local shape manifolds in favor of semantic analysis, the proposed geometric self-supervised and privileged learning algorithms can achieve superior performance to their backbone baselines and other state-of-the-art methods, which are verified in the experiments on the popular benchmarks.

READ FULL TEXT

page 1

page 3

page 5

research
08/01/2020

Self-supervised Learning of Point Clouds via Orientation Estimation

Point clouds provide a compact and efficient representation of 3D shapes...
research
03/30/2019

MortonNet: Self-Supervised Learning of Local Features in 3D Point Clouds

We present a self-supervised task on point clouds, in order to learn mea...
research
04/29/2020

Augmented Semantic Signatures of Airborne LiDAR Point Clouds for Comparison

LiDAR point clouds provide rich geometric information, which is particul...
research
05/30/2022

Neural Shape Mating: Self-Supervised Object Assembly with Adversarial Shape Priors

Learning to autonomously assemble shapes is a crucial skill for many rob...
research
05/05/2020

From Image Collections to Point Clouds with Self-supervised Shape and Pose Networks

Reconstructing 3D models from 2D images is one of the fundamental proble...
research
01/22/2020

LRF-Net: Learning Local Reference Frames for 3D Local Shape Description and Matching

The local reference frame (LRF) acts as a critical role in 3D local shap...
research
12/27/2021

SurFit: Learning to Fit Surfaces Improves Few Shot Learning on Point Clouds

We present SurFit, a simple approach for label efficient learning of 3D ...

Please sign up or login with your details

Forgot password? Click here to reset