Learning Agile Flights through Narrow Gaps with Varying Angles using Onboard Sensing

02/22/2023
by   Yuhan Xie, et al.
1

This paper addresses the problem of traversing through unknown, tilted, and narrow gaps for quadrotors using Deep Reinforcement Learning (DRL). Previous learning-based methods relied on accurate knowledge of the environment, including the gap's pose and size. In contrast, we integrate onboard sensing and detect the gap from a single onboard camera. The training problem is challenging for two reasons: a precise and robust whole-body planning and control policy is required for variable-tilted and narrow gaps, and an effective Sim2Real method is needed to successfully conduct real-world experiments. To this end, we propose a learning framework for agile gap traversal flight, which successfully trains the vehicle to traverse through the center of the gap at an approximate attitude to the gap with aggressive tilted angles. The policy trained only in a simulation environment can be transferred into different domains with fine-tuning while maintaining the success rate. Our proposed framework, which integrates onboard sensing and a neural network controller, achieves a success rate of 84.51 gap orientations up to 60deg. To the best of our knowledge, this is the first paper that performs the learning-based variable-tilted narrow gap traversal flight in the real world, without prior knowledge of the environment.

READ FULL TEXT

page 1

page 3

research
08/29/2021

Flying Through a Narrow Gap Using End-to-end Deep Reinforcement Learning Augmented with Curriculum Learning and Sim2Real

Traversing through a tilted narrow gap is previously an intractable task...
research
02/14/2018

GapFlyt: Active Vision Based Minimalist Structure-less Gap Detection For Quadrotor Flight

Although quadrotors, and aerial robots in general, are inherently active...
research
03/21/2019

Flying through a narrow gap using neural network: an end-to-end planning and control approach

In this paper, we investigate the problem of enabling a drone to fly thr...
research
03/06/2021

Passing Through Narrow Gaps with Deep Reinforcement Learning

The DARPA subterranean challenge requires teams of robots to traverse di...
research
11/22/2022

User-Conditioned Neural Control Policies for Mobile Robotics

Recently, learning-based controllers have been shown to push mobile robo...
research
09/22/2022

Learning Agile Flight Maneuvers: Deep SE(3) Motion Planning and Control for Quadrotors

Agile flights of autonomous quadrotors in cluttered environments require...
research
09/17/2022

Reinforcement Learning for Self-exploration in Narrow Spaces

In narrow spaces, motion planning based on the traditional hierarchical ...

Please sign up or login with your details

Forgot password? Click here to reset