Mapless Navigation of a Hybrid Aerial Underwater Vehicle with Deep Reinforcement Learning Through Environmental Generalization

09/13/2022
by   Ricardo B. Grando, et al.
0

Previous works showed that Deep-RL can be applied to perform mapless navigation, including the medium transition of Hybrid Unmanned Aerial Underwater Vehicles (HUAUVs). This paper presents new approaches based on the state-of-the-art actor-critic algorithms to address the navigation and medium transition problems for a HUAUV. We show that a double critic Deep-RL with Recurrent Neural Networks improves the navigation performance of HUAUVs using solely range data and relative localization. Our Deep-RL approaches achieved better navigation and transitioning capabilities with a solid generalization of learning through distinct simulated scenarios, outperforming previous approaches.

READ FULL TEXT

page 1

page 3

research
08/18/2023

DoCRL: Double Critic Deep Reinforcement Learning for Mapless Navigation of a Hybrid Aerial Underwater Vehicle with Medium Transition

Deep Reinforcement Learning (Deep-RL) techniques for motion control have...
research
12/27/2021

Double Critic Deep Reinforcement Learning for Mapless 3D Navigation of Unmanned Aerial Vehicles

This paper presents a novel deep reinforcement learning-based system for...
research
03/23/2021

Deep Reinforcement Learning for Mapless Navigation of a Hybrid Aerial Underwater Vehicle with Medium Transition

Since the application of Deep Q-Learning to the continuous action domain...
research
09/13/2022

Deterministic and Stochastic Analysis of Deep Reinforcement Learning for Low Dimensional Sensing-based Navigation of Mobile Robots

Deterministic and Stochastic techniques in Deep Reinforcement Learning (...
research
08/05/2021

Deep Reinforcement Learning for Continuous Docking Control of Autonomous Underwater Vehicles: A Benchmarking Study

Docking control of an autonomous underwater vehicle (AUV) is a task that...
research
10/01/2021

A Deep Learning Approach To Dead-Reckoning Navigation For Autonomous Underwater Vehicles With Limited Sensor Payloads

This paper presents a deep learning approach to aid dead-reckoning (DR) ...
research
01/06/2023

Contextual Autonomy Evaluation of Unmanned Aerial Vehicles in Subterranean Environments

In this paper we focus on the evaluation of contextual autonomy for robo...

Please sign up or login with your details

Forgot password? Click here to reset