Low Level Control of a Quadrotor with Deep Model-Based Reinforcement learning

01/11/2019
by   Nathan O. Lambert, et al.
0

Generating low-level robot controllers often requires manual parameters tuning and significant system knowledge, which can result in long design times for highly specialized controllers. With the growth of automation, the need for such controllers might grow faster than the number of expert designers. To address the problem of rapidly generating low-level controllers without domain knowledge, we propose using model-based reinforcement learning (MBRL) trained on few minutes of automatically generated data. In this paper, we explore the capabilities of MBRL on a Crazyflie quadrotor with rapid dynamics where existing classical control schemes offer a baseline against the new method's performance. To our knowledge, this is the first use of MBRL for low-level controlled hover of a quadrotor using only on-board sensors, direct motor input signals, and no initial dynamics knowledge. Our forward dynamics model for prediction is a neural network tuned to predict the state variables at the next time step, with a regularization term on the variance of predictions. The model predictive controller then transmits best actions from a GPU-enabled base station to the quadrotor firmware via radio. In our experiments, the quadrotor achieved hovering capability of up to 6 seconds with 3 minutes of experimental training data.

READ FULL TEXT

page 1

page 3

page 10

research
03/11/2019

Sim-to-(Multi)-Real: Transfer of Low-Level Robust Control Policies to Multiple Quadrotors

Quadrotor stabilizing controllers often require careful, model-specific ...
research
03/06/2018

Synthesizing Neural Network Controllers with Probabilistic Model based Reinforcement Learning

We present an algorithm for rapidly learning controllers for robotics sy...
research
01/04/2022

Using Simulation Optimization to Improve Zero-shot Policy Transfer of Quadrotors

In this work, we show that it is possible to train low-level control pol...
research
11/03/2017

Learning Stable and Energetically Economical Walking with RAMone

In this paper, we optimize over the control parameter space of our plana...
research
08/13/2022

Lyapunov Design for Robust and Efficient Robotic Reinforcement Learning

Recent advances in the reinforcement learning (RL) literature have enabl...
research
06/27/2022

Deep-Learning vs Regression: Prediction of Tourism Flow with Limited Data

Modern tourism in the 21st century is facing numerous challenges. One of...
research
12/08/2015

Reinforcement Control with Hierarchical Backpropagated Adaptive Critics

Present incremental learning methods are limited in the ability to achie...

Please sign up or login with your details

Forgot password? Click here to reset