Learning to Assist Drone Landings

11/26/2020
by   Kal Backman, et al.
0

Unmanned aerial vehicles (UAVs) are often used for navigating dangerous terrains, however they are difficult to pilot. Due to complex input-output mapping schemes, limited perception, the complex system dynamics and the need to maintain a safe operation distance, novice pilots experience difficulties in performing safe landings in obstacle filled environments. Previous work has proposed autonomous landing methods however these approaches do not adapt to the pilot's control inputs and require the pilot's goal to be known a priori. In this work we propose a shared autonomy approach that assists novice pilots to perform safe landings on one of several elevated platforms at a proficiency equal to or greater than experienced pilots. Our approach consists of two modules, a perceptual module and a policy module. The perceptual module compresses high dimensionality RGB-D images into a latent vector trained with a cross-modal variational auto-encoder. The policy module provides assistive control inputs trained with the reinforcement algorithm TD3. We conduct a user study (n=33) where participants land a simulated drone on a specified platform out of five candidate platforms with and without the use of the assistant. Despite the goal platform not being known to the assistant, participants of all skill levels were able to outperform experienced participants while assisted in the task.

READ FULL TEXT

page 4

page 5

research
02/07/2022

Reinforcement Learning for Shared Autonomy Drone Landings

Novice pilots find it difficult to operate and land unmanned aerial vehi...
research
06/16/2023

Learning to Assist and Communicate with Novice Drone Pilots for Expert Level Performance

Multi-task missions for unmanned aerial vehicles (UAVs) involving inspec...
research
09/09/2020

Unmanned Aerial Vehicle Control Through Domain-based Automatic Speech Recognition

Currently, unmanned aerial vehicles, such as drones, are becoming a part...
research
01/25/2022

PILOT: High-Precision Indoor Localization for Autonomous Drones

In many scenarios, unmanned aerial vehicles (UAVs), aka drones, need to ...
research
11/29/2021

Image Segmentation to Identify Safe Landing Zones for Unmanned Aerial Vehicles

There is a marked increase in delivery services in urban areas, and with...
research
02/15/2023

Cooperative Simultaneous Tracking and Jamming for Disabling a Rogue Drone

This work investigates the problem of simultaneous tracking and jamming ...

Please sign up or login with your details

Forgot password? Click here to reset