Beauty and the Beast: Optimal Methods Meet Learning for Drone Racing

10/15/2018
by   Elia Kaufmann, et al.
0

Autonomous micro aerial vehicles still struggle with fast and agile maneuvers, dynamic environments, imperfect sensing, and state estimation drift. Autonomous drone racing brings these challenges to the fore. Human pilots can fly a previously unseen track after a handful of practice runs. In contrast, state-of-the-art autonomous navigation algorithms require either a precise metric map of the environment or a large amount of training data collected in the track of interest. To bridge this gap, we propose an approach that can fly a new track in a previously unseen environment without a precise map or expensive data collection. Our approach represents the global track layout with coarse gate locations, which can be easily estimated from a single demonstration flight. At test time, a convolutional network predicts the poses of the closest gates along with their uncertainty. These predictions are incorporated by an extended Kalman filter to maintain optimal maximum-a-posteriori estimates of gate locations. This allows the framework to cope with misleading high-variance estimates that could stem from poor observability or lack of visible gates. Given the estimated gate poses, we use model predictive control to quickly and accurately navigate through the track. We conduct extensive experiments in the physical world, demonstrating agile and robust flight through complex and diverse previously-unseen race tracks. The presented approach was used to win the IROS 2018 Autonomous Drone Race Competition, outracing the second-placing team by a factor of two.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
09/16/2018

Autonomous drone race: A computationally efficient vision-based navigation and control strategy

Drone racing is becoming a popular sport where human pilots have to cont...
research
05/24/2019

Visual Model-predictive Localization for Computationally Efficient Autonomous Racing of a 72-gram Drone

Drone racing is becoming a popular e-sport all over the world, and beati...
research
09/13/2023

Time-Optimal Gate-Traversing Planner for Autonomous Drone Racing

In drone racing, the time-minimum trajectory is affected by the drone's ...
research
07/28/2022

PencilNet: Zero-Shot Sim-to-Real Transfer Learning for Robust Gate Perception in Autonomous Drone Racing

In autonomous and mobile robotics, one of the main challenges is the rob...
research
09/30/2021

The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competition

Robotics is the next frontier in the progress of Artificial Intelligence...
research
09/22/2022

Learning Agile Flight Maneuvers: Deep SE(3) Motion Planning and Control for Quadrotors

Agile flights of autonomous quadrotors in cluttered environments require...
research
04/05/2022

Event-based Navigation for Autonomous Drone Racing with Sparse Gated Recurrent Network

Event-based vision has already revolutionized the perception task for ro...

Please sign up or login with your details

Forgot password? Click here to reset