Deep Sensor Fusion for Real-Time Odometry Estimation

07/31/2019
by   Michelle Valente, et al.
15

Cameras and 2D laser scanners, in combination, are able to provide low-cost, light-weight and accurate solutions, which make their fusion well-suited for many robot navigation tasks. However, correct data fusion depends on precise calibration of the rigid body transform between the sensors. In this paper we present the first framework that makes use of Convolutional Neural Networks (CNNs) for odometry estimation fusing 2D laser scanners and mono-cameras. The use of CNNs provides the tools to not only extract the features from the two sensors, but also to fuse and match them without needing a calibration between the sensors. We transform the odometry estimation into an ordinal classification problem in order to find accurate rotation and translation values between consecutive frames. Results on a real road dataset show that the fusion network runs in real-time and is able to improve the odometry estimation of a single sensor alone by learning how to fuse two different types of data information.

READ FULL TEXT

page 1

page 3

page 4

research
02/22/2019

An LSTM Network for Real-Time Odometry Estimation

The use of 2D laser scanners is attractive for the autonomous driving in...
research
09/28/2021

Targetless Extrinsic Calibration of Stereo Cameras, Thermal Cameras, and Laser Sensors in the Wild

The fusion of multi-modal sensors has become increasingly popular in aut...
research
10/28/2021

Real-time multiview data fusion for object tracking with RGBD sensors

This paper presents a new approach to accurately track a moving vehicle ...
research
01/06/2018

Robust Dead Reckoning: Calibration, Covariance Estimation, Fusion and Integrity Monitoring

To measure system states and local environment directly with high precis...
research
03/10/2021

Real-Time RGBD Odometry for Fused-State Navigation Systems

This article describes an algorithm that provides visual odometry estima...
research
05/14/2022

Corrosion Detection for Industrial Objects: From Multi-Sensor System to 5D Feature Space

Corrosion is a form of damage that often appears on the surface of metal...
research
02/01/2022

Relative Transformation Estimation Based on Fusion of Odometry and UWB Ranging Data

In this work, the problem of 4 degree-of-freedom (3D position and headin...

Please sign up or login with your details

Forgot password? Click here to reset