Learning a Controller Fusion Network by Online Trajectory Filtering for Vision-based UAV Racing

04/18/2019
by   Matthias Müller, et al.
0

Autonomous UAV racing has recently emerged as an interesting research problem. The dream is to beat humans in this new fast-paced sport. A common approach is to learn an end-to-end policy that directly predicts controls from raw images by imitating an expert. However, such a policy is limited by the expert it imitates and scaling to other environments and vehicle dynamics is difficult. One approach to overcome the drawbacks of an end-to-end policy is to train a network only on the perception task and handle control with a PID or MPC controller. However, a single controller must be extensively tuned and cannot usually cover the whole state space. In this paper, we propose learning an optimized controller using a DNN that fuses multiple controllers. The network learns a robust controller with online trajectory filtering, which suppresses noisy trajectories and imperfections of individual controllers. The result is a network that is able to learn a good fusion of filtered trajectories from different controllers leading to significant improvements in overall performance. We compare our trained network to controllers it has learned from, end-to-end baselines and human pilots in a realistic simulation; our network beats all baselines in extensive experiments and approaches the performance of a professional human pilot. A video summarizing this work is available at https://youtu.be/hGKlE5X9Z5U

READ FULL TEXT

page 1

page 2

page 5

page 6

page 8

research
03/03/2018

Teaching UAVs to Race With Observational Imitation Learning

Recent work has tackled the problem of autonomous navigation by imitatin...
research
02/14/2023

Residual Policy Learning for Vehicle Control of Autonomous Racing Cars

The development of vehicle controllers for autonomous racing is challeng...
research
02/19/2019

Learning Task Agnostic Sufficiently Accurate Models

For complex real-world systems, designing controllers are a difficult ta...
research
07/12/2017

Learning a CNN-based End-to-End Controller for a Formula SAE Racecar

We present a set of CNN-based end-to-end models for controls of a Formul...
research
08/26/2019

Neural Flocking: MPC-based Supervised Learning of Flocking Controllers

We show how a distributed flocking controller can be synthesized using d...
research
03/28/2017

Feature Analysis and Selection for Training an End-to-End Autonomous Vehicle Controller Using the Deep Learning Approach

Deep learning-based approaches have been widely used for training contro...
research
03/07/2023

End-to-End Deep Visual Control for Mastering Needle-Picking Skills With World Models and Behavior Cloning

Needle picking is a challenging surgical task in robot-assisted surgery ...

Please sign up or login with your details

Forgot password? Click here to reset