LIFT-SLAM: a deep-learning feature-based monocular visual SLAM method

03/31/2021
by   Hudson M. S. Bruno, et al.
12

The Simultaneous Localization and Mapping (SLAM) problem addresses the possibility of a robot to localize itself in an unknown environment and simultaneously build a consistent map of this environment. Recently, cameras have been successfully used to get the environment's features to perform SLAM, which is referred to as visual SLAM (VSLAM). However, classical VSLAM algorithms can be easily induced to fail when either the motion of the robot or the environment is too challenging. Although new approaches based on Deep Neural Networks (DNNs) have achieved promising results in VSLAM, they still are unable to outperform traditional methods. To leverage the robustness of deep learning to enhance traditional VSLAM systems, we propose to combine the potential of deep learning-based feature descriptors with the traditional geometry-based VSLAM, building a new VSLAM system called LIFT-SLAM. Experiments conducted on KITTI and Euroc datasets show that deep learning can be used to improve the performance of traditional VSLAM systems, as the proposed approach was able to achieve results comparable to the state-of-the-art while being robust to sensorial noise. We enhance the proposed VSLAM pipeline by avoiding parameter tuning for specific datasets with an adaptive approach while evaluating how transfer learning can affect the quality of the features extracted.

READ FULL TEXT

page 10

page 14

page 17

page 21

research
03/31/2021

A comparative evaluation of learned feature descriptors on hybrid monocular visual SLAM methods

Classical Visual Simultaneous Localization and Mapping (VSLAM) algorithm...
research
09/05/2022

MuCaSLAM: CNN-Based Frame Quality Assessment for Mobile Robot with Omnidirectional Visual SLAM

In the proposed study, we describe an approach to improving the computat...
research
10/18/2022

Split-KalmanNet: A Robust Model-Based Deep Learning Approach for SLAM

Simultaneous localization and mapping (SLAM) is a method that constructs...
research
08/27/2022

Learning to SLAM on the Fly in Unknown Environments: A Continual Learning Approach for Drones in Visually Ambiguous Scenes

Learning to safely navigate in unknown environments is an important task...
research
09/13/2021

Stochastic Observer for SLAM on the Lie Group

A robust nonlinear stochastic observer for simultaneous localization and...
research
09/12/2022

A Review on Visual-SLAM: Advancements from Geometric Modelling to Learning-based Semantic Scene Understanding

Simultaneous Localisation and Mapping (SLAM) is one of the fundamental p...
research
02/28/2019

GCNv2: Efficient Correspondence Prediction for Real-Time SLAM

In this paper, we present a deep learning-based network, GCNv2, for gene...

Please sign up or login with your details

Forgot password? Click here to reset