Multi-Spectral Visual Odometry without Explicit Stereo Matching

08/23/2019
by   Weichen Dai, et al.
3

Multi-spectral sensors consisting of a standard (visible-light) camera and a long-wave infrared camera can simultaneously provide both visible and thermal images. Since thermal images are independent from environmental illumination, they can help to overcome certain limitations of standard cameras under complicated illumination conditions. However, due to the difference in the information source of the two types of cameras, their images usually share very low texture similarity. Hence, traditional texture-based feature matching methods cannot be directly applied to obtain stereo correspondences. To tackle this problem, a multi-spectral visual odometry method without explicit stereo matching is proposed in this paper. Bundle adjustment of multi-view stereo is performed on the visible and the thermal images using direct image alignment. Scale drift can be avoided by additional temporal observations of map points with the fixed-baseline stereo. Experimental results indicate that the proposed method can provide accurate visual odometry results with recovered metric scale. Moreover, the proposed method can also provide a metric 3D reconstruction in semi-dense density with multi-spectral information, which is not available from existing multi-spectral methods.

READ FULL TEXT

page 1

page 2

page 6

page 7

page 8

research
08/25/2017

Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras

We propose Stereo Direct Sparse Odometry (Stereo DSO) as a novel method ...
research
07/01/2020

A Dataset for Evaluating Multi-spectral Motion Estimation Methods

Visible images have been widely used for indoor motion estimation. Therm...
research
10/28/2018

Scale Estimation of Monocular SfM for a Multi-modal Stereo Camera

This paper proposes a novel method of estimating the absolute scale of m...
research
11/16/2019

Long Range 3D with Quadocular Thermal (LWIR) Camera

Long Wave Infrared (LWIR) cameras provide images regardles of the ambien...
research
03/01/2021

Unsupervised Depth and Ego-motion Estimation for Monocular Thermal Video using Multi-spectral Consistency Loss

Most of the deep-learning based depth and ego-motion networks have been ...
research
11/29/2011

Picture Collage with Genetic Algorithm and Stereo vision

In this paper, a salient region extraction method for creating picture c...
research
04/22/2023

VisiTherS: Visible-thermal infrared stereo disparity estimation of human silhouette

This paper presents a novel approach for visible-thermal infrared stereo...

Please sign up or login with your details

Forgot password? Click here to reset