Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy Optimization

by   Eivind Bøhn, et al.

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they can accomplish autonomously. This paper proposes a deep reinforcement learning (DRL) controller to handle the nonlinear attitude control problem, enabling extended flight envelopes for fixed-wing UAVs. A proof-of-concept controller using the proximal policy optimization (PPO) algorithm is developed, and is shown to be capable of stabilizing a fixed-wing UAV from a large set of initial conditions to reference roll, pitch and airspeed values. The training process is outlined and key factors for its progression rate are considered, with the most important factor found to be limiting the number of variables in the observation vector, and including values for several previous time steps for these variables. The trained reinforcement learning (RL) controller is compared to a proportional-integral-derivative (PID) controller, and is found to converge in more cases than the PID controller, with comparable performance. Furthermore, the RL controller is shown to generalize well to unseen disturbances in the form of wind and turbulence, even in severe disturbance conditions.


Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experiments

Attitude control of fixed-wing unmanned aerial vehicles (UAVs)is a diffi...

Reinforcement Learning for UAV Attitude Control

Autopilot systems are typically composed of an "inner loop" providing st...

A Reinforcement Learning Approach for Robust Supervisory Control of UAVs Under Disturbances

In this work, we present an approach to supervisory reinforcement learni...

Deep reinforcement learning reveals fewer sensors are needed for autonomous gust alleviation

There is a growing need for uncrewed aerial vehicles (UAVs) to operate i...

ArduSoar: an Open-Source Thermalling Controller for Resource-Constrained Autopilots

Autonomous soaring capability has the potential to significantly increas...

Planning and Control for a Dynamic Morphing-Wing UAV Using a Vortex Particle Model

Achieving precise, highly-dynamic maneuvers with Unmanned Aerial Vehicle...

Epersist: A Self Balancing Robot Using PID Controller And Deep Reinforcement Learning

A two-wheeled self-balancing robot is an example of an inverse pendulum ...

Please sign up or login with your details

Forgot password? Click here to reset