Autonomous Navigation via Deep Reinforcement Learning for Resource Constraint Edge Nodes using Transfer Learning

10/12/2019
by   Aqeel Anwar, et al.
33

Smart and agile drones are fast becoming ubiquitous at the edge of the cloud. The usage of these drones are constrained by their limited power and compute capability. In this paper, we present a Transfer Learning (TL) based approach to reduce on-board computation required to train a deep neural network for autonomous navigation via Deep Reinforcement Learning for a target algorithmic performance. A library of 3D realistic meta-environments is manually designed using Unreal Gaming Engine and the network is trained end-to-end. These trained meta-weights are then used as initializers to the network in a test environment and fine-tuned for the last few fully connected layers. Variation in drone dynamics and environmental characteristics is carried out to show robustness of the approach. Using NVIDIA GPU profiler it was shown that the energy consumption and training latency is reduced by 3.7x and 1.8x respectively without significant degradation in the performance in terms of average distance traveled before crash i.e. Mean Safe Flight (MSF). The approach is also tested on a real environment using DJI Tello drone and similar results were reported.

READ FULL TEXT

page 1

page 5

page 8

page 9

page 10

page 11

research
09/25/2019

Learning to Seek: Autonomous Source Seeking with Deep Reinforcement Learning Onboard a Nano Drone Microcontroller

Fully autonomous navigation using nano drones has numerous application i...
research
07/19/2023

A3D: Adaptive, Accurate, and Autonomous Navigation for Edge-Assisted Drones

Accurate navigation is of paramount importance to ensure flight safety a...
research
04/22/2019

Transfer and Online Reinforcement Learning in STT-MRAM Based Embedded Systems for Autonomous Drones

In this paper we present an algorithm-hardware codesign for camera-based...
research
09/16/2021

RAPID-RL: A Reconfigurable Architecture with Preemptive-Exits for Efficient Deep-Reinforcement Learning

Present-day Deep Reinforcement Learning (RL) systems show great promise ...
research
10/25/2021

A Deep Reinforcement Learning Approach for Audio-based Navigation and Audio Source Localization in Multi-speaker Environments

In this work we apply deep reinforcement learning to the problems of nav...
research
06/24/2020

Deep reinforcement learning for drone navigation using sensor data

Mobile robots such as unmanned aerial vehicles (drones) can be used for ...
research
07/23/2021

A Flexible Exoskeleton for Collision Resilience

With inspiration from arthropods' exoskeletons, we designed a simple, ea...

Please sign up or login with your details

Forgot password? Click here to reset