UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

04/07/2023
by   Xuyang Li, et al.
0

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment. The purpose is to make the UAV reach any target point from a certain starting point, and the flying height and speed are variable during navigation. In this work, we propose a deep reinforcement learning (DRL)-based method combined with human-in-the-loop, which allows the UAV to avoid obstacles automatically during flying. We design multiple reward functions based on the relevant domain knowledge to guide UAV navigation. The role of human-in-the-loop is to dynamically change the reward function of the UAV in different situations to suit the obstacle avoidance of the UAV better. We verify the success rate and average step size on urban, rural, and forest scenarios, and the experimental results show that the proposed method can reduce the training convergence time and improve the efficiency and accuracy of navigation tasks. The code is available on the website https://github.com/Monnalo/UAV_navigation.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
03/20/2022

Reinforcement learning reward function in unmanned aerial vehicle control tasks

This paper presents a new reward function that can be used for deep rein...
research
11/08/2018

Memory-based Deep Reinforcement Learning for Obstacle Avoidance in UAV with Limited Environment Knowledge

This paper presents our method for enabling a UAV quadrotor, equipped wi...
research
03/13/2023

Sim-to-Real Deep Reinforcement Learning based Obstacle Avoidance for UAVs under Measurement Uncertainty

Deep Reinforcement Learning is quickly becoming a popular method for tra...
research
11/13/2021

Obstacle Avoidance for UAS in Continuous Action Space Using Deep Reinforcement Learning

Obstacle avoidance for small unmanned aircraft is vital for the safety o...
research
09/30/2020

Explainable Deep Reinforcement Learning for UAV Autonomous Navigation

Modern deep reinforcement learning plays an important role to solve a wi...
research
08/02/2021

Three-Dimensional Trajectory Design for Multi-User MISO UAV Communications: A Deep Reinforcement Learning Approach

In this paper, we investigate a multi-user downlink multiple-input singl...
research
10/29/2019

Autonomous UAV Landing System Based on Visual Navigation

In this paper, we present an autonomous unmanned aerial vehicle (UAV) la...

Please sign up or login with your details

Forgot password? Click here to reset