Log In Sign Up

Robust Navigation for Racing Drones based on Imitation Learning and Modularization

by   Tianqi Wang, et al.

This paper presents a vision-based modularized drone racing navigation system that uses a customized convolutional neural network (CNN) for the perception module to produce high-level navigation commands and then leverages a state-of-the-art planner and controller to generate low-level control commands, thus exploiting the advantages of both data-based and model-based approaches. Unlike the state-of-the-art method which only takes the current camera image as the CNN input, we further add the latest three drone states as part of the inputs. Our method outperforms the state-of-the-art method in various track layouts and offers two switchable navigation behaviors with a single trained network. The CNN-based perception module is trained to imitate an expert policy that automatically generates ground truth navigation commands based on the pre-computed global trajectories. Owing to the extensive randomization and our modified dataset aggregation (DAgger) policy during data collection, our navigation system, which is purely trained in simulation with synthetic textures, successfully operates in environments with randomly-chosen photorealistic textures without further fine-tuning.


page 1

page 4

page 6


Deep Drone Racing: Learning Agile Flight in Dynamic Environments

Autonomous agile flight brings up fundamental challenges in robotics, su...

Deep Convolutional Neural Network-Based Autonomous Drone Navigation

This paper presents a novel approach for aerial drone autonomous navigat...

Deep Drone Racing: From Simulation to Reality with Domain Randomization

Dynamically changing environments, unreliable state estimation, and oper...

Vision-Based Autonomous Drone Control using Supervised Learning in Simulation

Limited power and computational resources, absence of high-end sensor eq...

Drone Path-Following in GPS-Denied Environments using Convolutional Networks

his paper presents a simple approach for drone navigation to follow a pr...

Gesture Control of Micro-drone: A Lightweight-Net with Domain Randomization and Trajectory Generators

Micro-drones can be integrated into various industrial applications but ...

Learning to Navigate Autonomously in Outdoor Environments : MAVNet

In the modern era of automation and robotics, autonomous vehicles are cu...