DeepAI AI Chat
Log In Sign Up

Robust Reinforcement Learning Algorithm for Vision-based Ship Landing of UAVs

by   Vishnu Saj, et al.
Texas A&M University

This paper addresses the problem of developing an algorithm for autonomous ship landing of vertical take-off and landing (VTOL) capable unmanned aerial vehicles (UAVs), using only a monocular camera in the UAV for tracking and localization. Ship landing is a challenging task due to the small landing space, six degrees of freedom ship deck motion, limited visual references for localization, and adversarial environmental conditions such as wind gusts. We first develop a computer vision algorithm which estimates the relative position of the UAV with respect to a horizon reference bar on the landing platform using the image stream from a monocular vision camera on the UAV. Our approach is motivated by the actual ship landing procedure followed by the Navy helicopter pilots in tracking the horizon reference bar as a visual cue. We then develop a robust reinforcement learning (RL) algorithm for controlling the UAV towards the landing platform even in the presence of adversarial environmental conditions such as wind gusts. We demonstrate the superior performance of our algorithm compared to a benchmark nonlinear PID control approach, both in the simulation experiments using the Gazebo environment and in the real-world setting using a Parrot ANAFI quad-rotor and sub-scale ship platform undergoing 6 degrees of freedom (DOF) deck motion.


page 1

page 2

page 6


Intelligent Vision-based Autonomous Ship Landing of VTOL UAVs

The paper discusses an intelligent vision-based control solution for aut...

Deep UAV Localization with Reference View Rendering

This paper presents a framework for the localization of Unmanned Aerial ...

Precision Landing of a UAV on a Moving Platform for Outdoor Applications

As UAV technology improves, more uses have been found for these versatil...

A Reinforcement Learning Approach for Robust Supervisory Control of UAVs Under Disturbances

In this work, we present an approach to supervisory reinforcement learni...

XTDrone: A Customizable Multi-Rotor UAVs Simulation Platform

A customizable multi-rotor UAVs simulation platform based on ROS, Gazebo...

Aerial View Goal Localization with Reinforcement Learning

With an increased amount and availability of unmanned aerial vehicles (U...