DeepAI AI Chat
Log In Sign Up

SSTN: Self-Supervised Domain Adaptation Thermal Object Detection for Autonomous Driving

by   Farzeen Munir, et al.

The sensibility and sensitivity of the environment play a decisive role in the safe and secure operation of autonomous vehicles. This perception of the surrounding is way similar to human visual representation. The human's brain perceives the environment by utilizing different sensory channels and develop a view-invariant representation model. Keeping in this context, different exteroceptive sensors are deployed on the autonomous vehicle for perceiving the environment. The most common exteroceptive sensors are camera, Lidar and radar for autonomous vehicle's perception. Despite being these sensors have illustrated their benefit in the visible spectrum domain yet in the adverse weather conditions, for instance, at night, they have limited operation capability, which may lead to fatal accidents. In this work, we explore thermal object detection to model a view-invariant model representation by employing the self-supervised contrastive learning approach. For this purpose, we have proposed a deep neural network Self Supervised Thermal Network (SSTN) for learning the feature embedding to maximize the information between visible and infrared spectrum domain by contrastive learning, and later employing these learned feature representation for the thermal object detection using multi-scale encoder-decoder transformer network. The proposed method is extensively evaluated on the two publicly available datasets: the FLIR-ADAS dataset and the KAIST Multi-Spectral dataset. The experimental results illustrate the efficacy of the proposed method.


page 1

page 3

page 8


Thermal Object Detection using Domain Adaptation through Style Consistency

A recent fatal accident of an autonomous vehicle opens a debate about th...

ARTSeg: Employing Attention for Thermal images Semantic Segmentation

The research advancements have made the neural network algorithms deploy...

Channel Boosting Feature Ensemble for Radar-based Object Detection

Autonomous vehicles are conceived to provide safe and secure services by...

Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data

Segmenting or detecting objects in sparse Lidar point clouds are two imp...

GenRadar: Self-supervised Probabilistic Camera Synthesis based on Radar Frequencies

Autonomous systems require a continuous and dependable environment perce...