CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data

02/03/2023
by   Junyi Ma, et al.
0

LiDAR-based place recognition (LPR) is one of the most crucial components of autonomous vehicles to identify previously visited places in GPS-denied environments. Most existing LPR methods use mundane representations of the input point cloud without considering different views, which may not fully exploit the information from LiDAR sensors. In this paper, we propose a cross-view transformer-based network, dubbed CVTNet, to fuse the range image views (RIVs) and bird's eye views (BEVs) generated from the LiDAR data. It extracts correlations within the views themselves using intra-transformers and between the two different views using inter-transformers. Based on that, our proposed CVTNet generates a yaw-angle-invariant global descriptor for each laser scan end-to-end online and retrieves previously seen places by descriptor matching between the current query scan and the pre-built database. We evaluate our approach on three datasets collected with different sensor setups and environmental conditions. The experimental results show that our method outperforms the state-of-the-art LPR methods with strong robustness to viewpoint changes and long-time spans. Furthermore, our approach has a good real-time performance that can run faster than the typical LiDAR frame rate. The implementation of our method is released as open source at: https://github.com/BIT-MJY/CVTNet.

READ FULL TEXT

page 1

page 3

page 5

research
09/16/2022

SeqOT: A Spatial-Temporal Transformer Network for Place Recognition Using Sequential LiDAR Data

Place recognition is an important component for autonomous vehicles to a...
research
03/07/2022

OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognition

Place recognition is an important capability for autonomously navigating...
research
09/01/2021

BVMatch: Lidar-based Place Recognition Using Bird's-eye View Images

Recognizing places using Lidar in large-scale environments is challengin...
research
04/16/2023

PCPNet: An Efficient and Semantic-Enhanced Transformer Network for Point Cloud Prediction

The ability to predict future structure features of environments based o...
research
04/12/2021

MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition

We introduce a discriminative multimodal descriptor based on a pair of s...
research
11/30/2018

Local Descriptor for Robust Place Recognition using LiDAR Intensity

Place recognition is a challenging problem in mobile robotics, especiall...
research
11/30/2020

Locus: LiDAR-based Place Recognition using Spatiotemporal Higher-Order Pooling

Place Recognition (PR) enables the estimation of a globally consistent m...

Please sign up or login with your details

Forgot password? Click here to reset