Thermal Object Detection using Domain Adaptation through Style Consistency

06/01/2020
by   Farzeen Munir, et al.
0

A recent fatal accident of an autonomous vehicle opens a debate about the use of infrared technology in the sensor suite for autonomous driving to increase visibility for robust object detection. Thermal imaging has an advantage over lidar, radar, and camera because it can detect the heat difference emitted by objects in the infrared spectrum. In contrast, lidar and camera capture in the visible spectrum, and adverse weather conditions can impact their accuracy. The limitations of object detection in images from conventional imaging sensors can be catered to by thermal images. This paper presents a domain adaptation method for object detection in thermal images. We explore multiple ideas of domain adaption. First, a generative adversarial network is used to transfer the low-level features from the visible spectrum to the infrared spectrum domain through style consistency. Second, a cross-domain model with style consistency is used for object detection in the infrared spectrum by transferring the trained visible spectrum model. The proposed strategies are evaluated on publicly available thermal image datasets (FLIR ADAS and KAIST Multi-Spectral). We find that adapting the low-level features from the source domain to the target domain through domain adaptation increases in mean average precision by approximately 10

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 9

research
09/30/2019

Enhancing Object Detection in Adverse Conditions using Thermal Imaging

Autonomous driving relies on deriving understanding of objects and scene...
research
03/04/2021

SSTN: Self-Supervised Domain Adaptation Thermal Object Detection for Autonomous Driving

The sensibility and sensitivity of the environment play a decisive role ...
research
11/22/2019

Domain Adaptation for Object Detection via Style Consistency

We propose a domain adaptation approach for object detection. We introdu...
research
02/05/2021

Multispectral Object Detection with Deep Learning

Object detection in natural scenes can be a challenging task. In many re...
research
03/27/2020

Combining Visible and Infrared Spectrum Imagery using Machine Learning for Small Unmanned Aerial System Detection

Advances in machine learning and deep neural networks for object detecti...
research
02/17/2020

Unsupervised Image-generation Enhanced Adaptation for Object Detection in Thermal images

Object detection in thermal images is an important computer vision task ...
research
01/05/2022

Evaluation of Thermal Imaging on Embedded GPU Platforms for Application in Vehicular Assistance Systems

This study is focused on evaluating the real-time performance of thermal...

Please sign up or login with your details

Forgot password? Click here to reset