Online Self-supervised Scene Segmentation for Micro Aerial Vehicles

06/13/2018
by   Shreyansh Daftry, et al.
0

Recently, there have been numerous advances in the development of payload and power constrained lightweight Micro Aerial Vehicles (MAVs). As these robots aspire for high-speed autonomous flights in complex dynamic environments, robust scene understanding at long-range becomes critical. The problem is heavily characterized by either the limitations imposed by sensor capabilities for geometry-based methods, or the need for large-amounts of manually annotated training data required by data-driven methods. This motivates the need to build systems that have the capability to alleviate these problems by exploiting the complimentary strengths of both geometry and data-driven methods. In this paper, we take a step in this direction and propose a generic framework for adaptive scene segmentation using self-supervised online learning. We present this in the context of vision-based autonomous MAV flight, and demonstrate the efficacy of our proposed system through extensive experiments on benchmark datasets and real-world field tests.

READ FULL TEXT
research
07/28/2016

Introspective Perception: Learning to Predict Failures in Vision Systems

As robots aspire for long-term autonomous operations in complex dynamic ...
research
11/12/2018

A Perceptual Prediction Framework for Self Supervised Event Segmentation

Temporal segmentation of long videos is an important problem, that has l...
research
09/19/2022

NeRF-SOS: Any-View Self-supervised Object Segmentation from Complex Real-World Scenes

Neural volumetric representations have shown the potential that Multi-la...
research
04/08/2016

Free-Space Detection with Self-Supervised and Online Trained Fully Convolutional Networks

Recently, vision-based Advanced Driver Assist Systems have gained broad ...
research
07/18/2023

Online Self-Supervised Thermal Water Segmentation for Aerial Vehicles

We present a new method to adapt an RGB-trained water segmentation netwo...
research
03/02/2022

Self-Supervised Online Learning for Safety-Critical Control using Stereo Vision

With the increasing prevalence of complex vision-based sensing methods f...
research
03/05/2021

LoRa Backscatter Assisted State Estimator for Micro Aerial Vehicles with Online Initialization

The advances in agile micro aerial vehicles (MAVs) have shown great pote...

Please sign up or login with your details

Forgot password? Click here to reset