PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition

04/10/2018
by   Mikaela Angelina Uy, et al.
0

Unlike its image based counterpart, point cloud based retrieval for place recognition has remained as an unexplored and unsolved problem. This is largely due to the difficulty in extracting local feature descriptors from a point cloud that can subsequently be encoded into a global descriptor for the retrieval task. In this paper, we propose the PointNetVLAD where we leverage on the recent success of deep networks to solve point cloud based retrieval for place recognition. Specifically, our PointNetVLAD is a combination/modification of the existing PointNet and NetVLAD, which allows end-to-end training and inference to extract the global descriptor from a given 3D point cloud. Furthermore, we propose the "lazy triplet and quadruplet" loss functions that can achieve more discriminative and generalizable global descriptors to tackle the retrieval task. We create benchmark datasets for point cloud based retrieval for place recognition, and the experimental results on these datasets show the feasibility of our PointNetVLAD.

READ FULL TEXT

page 1

page 3

research
12/11/2018

3D Point Cloud Learning for Large-scale Environment Analysis and Place Recognition

In this paper, we develop a new deep neural network which can extract di...
research
04/22/2019

PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrieval

Point cloud based retrieval for place recognition is an emerging problem...
research
01/07/2021

Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognition

Point cloud based retrieval for place recognition is still a challenging...
research
04/22/2019

2D3D-MatchNet: Learning to Match Keypoints Across 2D Image and 3D Point Cloud

Large-scale point cloud generated from 3D sensors is more accurate than ...
research
09/23/2022

GIDP: Learning a Good Initialization and Inducing Descriptor Post-enhancing for Large-scale Place Recognition

Large-scale place recognition is a fundamental but challenging task, whi...
research
02/29/2020

Augmenting Visual Place Recognition with Structural Cues

In this paper, we propose to augment image-based place recognition with ...
research
03/02/2022

Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Training

The paper presents a simple and effective learning-based method for comp...

Please sign up or login with your details

Forgot password? Click here to reset