Nonholonomic Yaw Control of an Underactuated Flying Robot with Model-based Reinforcement Learning

09/02/2020
by   Nathan Lambert, et al.
0

Nonholonomic control is a candidate to control nonlinear systems with path-dependant states. We investigate an underactuated flying micro-aerial-vehicle, the ionocraft, that requires nonholonomic control in the yaw-direction for complete attitude control. Deploying an analytical control law involves substantial engineering design and is sensitive to inaccuracy in the system model. With specific assumptions on assembly and system dynamics, we derive a Lie bracket for yaw control of the ionocraft. As a comparison to the significant engineering effort required for an analytic control law, we implement a data-driven model-based reinforcement learning yaw controller in a simulated flight task. We demonstrate that a simple model-based reinforcement learning framework can match the derived Lie bracket control (in yaw rate and chosen actions) in a few minutes of flight data, without a pre-defined dynamics function. This paper shows that learning-based approaches are useful as a tool for synthesis of nonlinear control laws previously only addressable through expert-based design.

READ FULL TEXT
research
11/07/2021

Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experiments

Attitude control of fixed-wing unmanned aerial vehicles (UAVs)is a diffi...
research
11/22/2020

Model Predictive Control for Micro Aerial Vehicles: A Survey

This paper presents a review of the design and application of model pred...
research
03/19/2020

Learning to Fly via Deep Model-Based Reinforcement Learning

Learning to control robots without requiring models has been a long-term...
research
02/25/2019

Learning Extreme Hummingbird Maneuvers on Flapping Wing Robots

Biological studies show that hummingbirds can perform extreme aerobatic ...
research
12/11/2021

Control-Tutored Reinforcement Learning: Towards the Integration of Data-Driven and Model-Based Control

We present an architecture where a feedback controller derived on an app...
research
02/10/2015

Gaussian Processes for Data-Efficient Learning in Robotics and Control

Autonomous learning has been a promising direction in control and roboti...
research
06/10/2023

How to Learn and Generalize From Three Minutes of Data: Physics-Constrained and Uncertainty-Aware Neural Stochastic Differential Equations

We present a framework and algorithms to learn controlled dynamics model...

Please sign up or login with your details

Forgot password? Click here to reset