Event-based Navigation for Autonomous Drone Racing with Sparse Gated Recurrent Network

04/05/2022
by   Kristoffer Fogh Andersen, et al.
0

Event-based vision has already revolutionized the perception task for robots by promising faster response, lower energy consumption, and lower bandwidth without introducing motion blur. In this work, a novel deep learning method based on gated recurrent units utilizing sparse convolutions for detecting gates in a race track is proposed using event-based vision for the autonomous drone racing problem. We demonstrate the efficiency and efficacy of the perception pipeline on a real robot platform that can safely navigate a typical autonomous drone racing track in real-time. Throughout the experiments, we show that the event-based vision with the proposed gated recurrent unit and pretrained models on simulated event data significantly improve the gate detection precision. Furthermore, an event-based drone racing dataset consisting of both simulated and real data sequences is publicly released.

READ FULL TEXT

page 4

page 5

research
05/26/2020

AlphaPilot: Autonomous Drone Racing

This paper presents a novel system for autonomous, vision-based drone ra...
research
05/24/2019

Visual Model-predictive Localization for Computationally Efficient Autonomous Racing of a 72-gram Drone

Drone racing is becoming a popular e-sport all over the world, and beati...
research
07/28/2022

PencilNet: Zero-Shot Sim-to-Real Transfer Learning for Robust Gate Perception in Autonomous Drone Racing

In autonomous and mobile robotics, one of the main challenges is the rob...
research
08/06/2020

Image Generation for Efficient Neural Network Training in Autonomous Drone Racing

Drone racing is a recreational sport in which the goal is to pass throug...
research
09/13/2023

Time-Optimal Gate-Traversing Planner for Autonomous Drone Racing

In drone racing, the time-minimum trajectory is affected by the drone's ...
research
06/28/2023

Autonomous Drone Racing: Time-Optimal Spatial Iterative Learning Control within a Virtual Tube

It is often necessary for drones to complete delivery, photography, and ...
research
10/15/2018

Beauty and the Beast: Optimal Methods Meet Learning for Drone Racing

Autonomous micro aerial vehicles still struggle with fast and agile mane...

Please sign up or login with your details

Forgot password? Click here to reset