Target Search and Navigation in Heterogeneous Robot Systems with Deep Reinforcement Learning

08/01/2023
by   Yun Chen, et al.
0

Collaborative heterogeneous robot systems can greatly improve the efficiency of target search and navigation tasks. In this paper, we design a heterogeneous robot system consisting of a UAV and a UGV for search and rescue missions in unknown environments. The system is able to search for targets and navigate to them in a maze-like mine environment with the policies learned through deep reinforcement learning algorithms. During the training process, if two robots are trained simultaneously, the rewards related to their collaboration may not be properly obtained. Hence, we introduce a multi-stage reinforcement learning framework and a curiosity module to encourage agents to explore unvisited environments. Experiments in simulation environments show that our framework can train the heterogeneous robot system to achieve the search and navigation with unknown target locations while existing baselines may not, and accelerate the training speed.

READ FULL TEXT

page 1

page 7

research
09/07/2022

Obtaining Robust Control and Navigation Policies for Multi-Robot Navigation via Deep Reinforcement Learning

Multi-robot navigation is a challenging task in which multiple robots mu...
research
07/30/2018

Learning to Interrupt: A Hierarchical Deep Reinforcement Learning Framework for Efficient Exploration

To achieve scenario intelligence, humans must transfer knowledge to robo...
research
11/27/2018

Learning with Stochastic Guidance for Navigation

Due to the sparse rewards and high degree of environment variation, rein...
research
08/31/2020

Control of a Nature-inspired Scorpion using Reinforcement Learning

A terrestrial robot that can maneuver rough terrain and scout places is ...
research
09/14/2019

Neuromodulated Patience for Robot and Self-Driving Vehicle Navigation

Robots and self-driving vehicles face a number of challenges when naviga...
research
09/28/2021

Meta Reinforcement Learning Based Sensor Scanning in 3D Uncertain Environments for Heterogeneous Multi-Robot Systems

We study a novel problem that tackles learning based sensor scanning in ...
research
06/24/2021

Multi-Robot Deep Reinforcement Learning for Mobile Navigation

Deep reinforcement learning algorithms require large and diverse dataset...

Please sign up or login with your details

Forgot password? Click here to reset