NeeDrop: Self-supervised Shape Representation from Sparse Point Clouds using Needle Dropping

11/30/2021
by   Alexandre Boulch, et al.
7

There has been recently a growing interest for implicit shape representations. Contrary to explicit representations, they have no resolution limitations and they easily deal with a wide variety of surface topologies. To learn these implicit representations, current approaches rely on a certain level of shape supervision (e.g., inside/outside information or distance-to-shape knowledge), or at least require a dense point cloud (to approximate well enough the distance-to-shape). In contrast, we introduce NeeDrop, a self-supervised method for learning shape representations from possibly extremely sparse point clouds. Like in Buffon's needle problem, we "drop" (sample) needles on the point cloud and consider that, statistically, close to the surface, the needle end points lie on opposite sides of the surface. No shape knowledge is required and the point cloud can be highly sparse, e.g., as lidar point clouds acquired by vehicles. Previous self-supervised shape representation approaches fail to produce good-quality results on this kind of data. We obtain quantitative results on par with existing supervised approaches on shape reconstruction datasets and show promising qualitative results on hard autonomous driving datasets such as KITTI.

READ FULL TEXT

page 3

page 7

page 14

page 15

page 17

page 21

page 22

research
03/29/2023

Point2Vec for Self-Supervised Representation Learning on Point Clouds

Recently, the self-supervised learning framework data2vec has shown insp...
research
01/03/2022

Implicit Autoencoder for Point Cloud Self-supervised Representation Learning

Many 3D representations (e.g., point clouds) are discrete samples of the...
research
05/27/2022

ANISE: Assembly-based Neural Implicit Surface rEconstruction

We present ANISE, a method that reconstructs a 3D shape from partial obs...
research
04/03/2023

Self-Ordering Point Clouds

In this paper we address the task of finding representative subsets of p...
research
02/22/2017

3D Reconstruction of Temples in the Special Region of Yogyakarta By Using Close-Range Photogrammetry

Object reconstruction is one of the main problems in cultural heritage p...
research
03/30/2020

Label-Efficient Learning on Point Clouds using Approximate Convex Decompositions

The problems of shape classification and part segmentation from 3D point...
research
04/18/2021

Self-Supervised Pillar Motion Learning for Autonomous Driving

Autonomous driving can benefit from motion behavior comprehension when i...

Please sign up or login with your details

Forgot password? Click here to reset