Online Self-Supervised Thermal Water Segmentation for Aerial Vehicles

07/18/2023
by   Connor Lee, et al.
0

We present a new method to adapt an RGB-trained water segmentation network to target-domain aerial thermal imagery using online self-supervision by leveraging texture and motion cues as supervisory signals. This new thermal capability enables current autonomous aerial robots operating in near-shore environments to perform tasks such as visual navigation, bathymetry, and flow tracking at night. Our method overcomes the problem of scarce and difficult-to-obtain near-shore thermal data that prevents the application of conventional supervised and unsupervised methods. In this work, we curate the first aerial thermal near-shore dataset, show that our approach outperforms fully-supervised segmentation models trained on limited target-domain thermal data, and demonstrate real-time capabilities onboard an Nvidia Jetson embedded computing platform. Code and datasets used in this work will be available at: https://github.com/connorlee77/uav-thermal-water-segmentation.

READ FULL TEXT

page 2

page 4

page 5

research
10/09/2022

Unsupervised RGB-to-Thermal Domain Adaptation via Multi-Domain Attention Network

This work presents a new method for unsupervised thermal image classific...
research
06/14/2021

Self-training Guided Adversarial Domain Adaptation For Thermal Imagery

Deep models trained on large-scale RGB image datasets have shown tremend...
research
01/12/2022

Maximizing Self-supervision from Thermal Image for Effective Self-supervised Learning of Depth and Ego-motion

Recently, self-supervised learning of depth and ego-motion from thermal ...
research
04/26/2023

What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging

Inferring past human motion from RGB images is challenging due to the in...
research
04/14/2023

Spectral Transfer Guided Active Domain Adaptation For Thermal Imagery

The exploitation of visible spectrum datasets has led deep networks to s...
research
06/13/2018

Online Self-supervised Scene Segmentation for Micro Aerial Vehicles

Recently, there have been numerous advances in the development of payloa...
research
08/02/2021

Multispectral Vineyard Segmentation: A Deep Learning approach

Digital agriculture has evolved significantly over the last few years du...

Please sign up or login with your details

Forgot password? Click here to reset