Stereo Visual Odometry with Deep Learning-Based Point and Line Feature Matching using an Attention Graph Neural Network

08/02/2023
by   Shenbagaraj Kannapiran, et al.
0

Robust feature matching forms the backbone for most Visual Simultaneous Localization and Mapping (vSLAM), visual odometry, 3D reconstruction, and Structure from Motion (SfM) algorithms. However, recovering feature matches from texture-poor scenes is a major challenge and still remains an open area of research. In this paper, we present a Stereo Visual Odometry (StereoVO) technique based on point and line features which uses a novel feature-matching mechanism based on an Attention Graph Neural Network that is designed to perform well even under adverse weather conditions such as fog, haze, rain, and snow, and dynamic lighting conditions such as nighttime illumination and glare scenarios. We perform experiments on multiple real and synthetic datasets to validate the ability of our method to perform StereoVO under low visibility weather and lighting conditions through robust point and line matches. The results demonstrate that our method achieves more line feature matches than state-of-the-art line matching algorithms, which when complemented with point feature matches perform consistently well in adverse weather and dynamic lighting conditions.

READ FULL TEXT

page 1

page 6

research
05/17/2022

DynPL-SVO: A New Method Using Point and Line Features for Stereo Visual Odometry in Dynamic Scenes

Stereo visual odometry is widely used where a robot tracks its position ...
research
09/25/2018

Geometric-based Line Segment Tracking for HDR Stereo Sequences

In this work, we propose a purely geometrical approach for the robust ma...
research
09/11/2023

Evaluating Visual Odometry Methods for Autonomous Driving in Rain

The increasing demand for autonomous vehicles has created a need for rob...
research
07/05/2017

Learning-based Image Enhancement for Visual Odometry in Challenging HDR Environments

Most approaches to stereo visual odometry reconstruct the motion based o...
research
02/08/2021

Learned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching

Successful visual navigation depends upon capturing images that contain ...
research
03/21/2023

Online Learning of Wheel Odometry Correction for Mobile Robots with Attention-based Neural Network

Modern robotic platforms need a reliable localization system to operate ...
research
03/05/2020

DeepMEL: Compiling Visual Multi-Experience Localization into a Deep Neural Network

Vision-based path following allows robots to autonomously repeat manuall...

Please sign up or login with your details

Forgot password? Click here to reset