Maximizing Self-supervision from Thermal Image for Effective Self-supervised Learning of Depth and Ego-motion

01/12/2022
by   Ukcheol Shin, et al.
14

Recently, self-supervised learning of depth and ego-motion from thermal images shows strong robustness and reliability under challenging scenarios. However, the inherent thermal image properties such as weak contrast, blurry edges, and noise hinder to generate effective self-supervision from thermal images. Therefore, most research relies on additional self-supervision sources such as well-lit RGB images, generative models, and Lidar information. In this paper, we conduct an in-depth analysis of thermal image characteristics that degenerates self-supervision from thermal images. Based on the analysis, we propose an effective thermal image mapping method that significantly increases image information, such as overall structure, contrast, and details, while preserving temporal consistency. The proposed method shows outperformed depth and pose results than previous state-of-the-art networks without leveraging additional RGB guidance.

READ FULL TEXT

page 1

page 3

page 7

research
03/01/2021

Unsupervised Depth and Ego-motion Estimation for Monocular Thermal Video using Multi-spectral Consistency Loss

Most of the deep-learning based depth and ego-motion networks have been ...
research
09/19/2019

Self-Supervised Learning of Depth and Motion Under Photometric Inconsistency

The self-supervised learning of depth and pose from monocular sequences ...
research
08/25/2023

Self-supervised learning for hotspot detection and isolation from thermal images

Hotspot detection using thermal imaging has recently become essential in...
research
07/18/2023

Online Self-Supervised Thermal Water Segmentation for Aerial Vehicles

We present a new method to adapt an RGB-trained water segmentation netwo...
research
03/03/2022

Self-Supervised Ego-Motion Estimation Based on Multi-Layer Fusion of RGB and Inferred Depth

In existing self-supervised depth and ego-motion estimation methods, ego...
research
02/14/2023

Event-guided Multi-patch Network with Self-supervision for Non-uniform Motion Deblurring

Contemporary deep learning multi-scale deblurring models suffer from man...
research
11/20/2020

Planning Folding Motion with Simulation in the Loop Using Laser Forming Origami and Thermal Behaviors as an Example

Designing a robot or structure that can fold itself into a target shape ...

Please sign up or login with your details

Forgot password? Click here to reset