Meta-UDA: Unsupervised Domain Adaptive Thermal Object Detection using Meta-Learning

10/07/2021
by   Vibashan VS, et al.
0

Object detectors trained on large-scale RGB datasets are being extensively employed in real-world applications. However, these RGB-trained models suffer a performance drop under adverse illumination and lighting conditions. Infrared (IR) cameras are robust under such conditions and can be helpful in real-world applications. Though thermal cameras are widely used for military applications and increasingly for commercial applications, there is a lack of robust algorithms to robustly exploit the thermal imagery due to the limited availability of labeled thermal data. In this work, we aim to enhance the object detection performance in the thermal domain by leveraging the labeled visible domain data in an Unsupervised Domain Adaptation (UDA) setting. We propose an algorithm agnostic meta-learning framework to improve existing UDA methods instead of proposing a new UDA strategy. We achieve this by meta-learning the initial condition of the detector, which facilitates the adaptation process with fine updates without overfitting or getting stuck at local optima. However, meta-learning the initial condition for the detection scenario is computationally heavy due to long and intractable computation graphs. Therefore, we propose an online meta-learning paradigm which performs online updates resulting in a short and tractable computation graph. To this end, we demonstrate the superiority of our method over many baselines in the UDA setting, producing a state-of-the-art thermal detector for the KAIST and DSIAC datasets.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 12

research
04/09/2020

Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation

Domain adaptation (DA) is the topical problem of adapting models from la...
research
04/14/2023

Spectral Transfer Guided Active Domain Adaptation For Thermal Imagery

The exploitation of visible spectrum datasets has led deep networks to s...
research
06/14/2021

Self-training Guided Adversarial Domain Adaptation For Thermal Imagery

Deep models trained on large-scale RGB image datasets have shown tremend...
research
03/07/2022

An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions

Integrating different representations from complementary sensing modalit...
research
03/25/2021

MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation

For unsupervised domain adaptation (UDA), to alleviate the effect of dom...
research
04/11/2022

Towards Online Domain Adaptive Object Detection

Existing object detection models assume both the training and test data ...
research
04/02/2020

Tracking by Instance Detection: A Meta-Learning Approach

We consider the tracking problem as a special type of object detection p...

Please sign up or login with your details

Forgot password? Click here to reset