MUI-TARE: Multi-Agent Cooperative Exploration with Unknown Initial Position

09/22/2022
by   Jingtian Yan, et al.
0

Multi-agent exploration of a bounded 3D environment with unknown initial positions of agents is a challenging problem. It requires quickly exploring the environments as well as robustly merging the sub-maps built by the agents. We take the view that the existing approaches are either aggressive or conservative: Aggressive strategies merge two sub-maps built by different agents together when overlap is detected, which can lead to incorrect merging due to the false-positive detection of the overlap and is thus not robust. Conservative strategies direct one agent to revisit an excessive amount of the historical trajectory of another agent for verification before merging, which can lower the exploration efficiency due to the repeated exploration of the same space. To intelligently balance the robustness of sub-map merging and exploration efficiency, we develop a new approach for lidar-based multi-agent exploration, which can direct one agent to repeat another agent's trajectory in an adaptive manner based on the quality indicator of the sub-map merging process. Additionally, our approach extends the recent single-agent hierarchical exploration strategy to multiple agents in a cooperative manner by planning for agents with merged sub-maps together to further improve exploration efficiency. Our experiments show that our approach is up to 50% more efficient than the baselines on average while merging sub-maps robustly.

READ FULL TEXT

page 1

page 3

page 6

research
07/23/2021

Cooperative Exploration for Multi-Agent Deep Reinforcement Learning

Exploration is critical for good results in deep reinforcement learning ...
research
06/08/2021

Formal Verification of a Map Merging Protocol in the Multi-Agent Programming Contest

Communication is a critical part of enabling multi-agent systems to coop...
research
08/22/2023

FoX: Formation-aware exploration in multi-agent reinforcement learning

Recently, deep multi-agent reinforcement learning (MARL) has gained sign...
research
02/07/2023

Ensemble Value Functions for Efficient Exploration in Multi-Agent Reinforcement Learning

Cooperative multi-agent reinforcement learning (MARL) requires agents to...
research
07/14/2022

AutoMerge: A Framework for Map Assembling and Smoothing in City-scale Environments

We present AutoMerge, a LiDAR data processing framework for assembling a...
research
07/30/2023

Efficient Q-Learning over Visit Frequency Maps for Multi-agent Exploration of Unknown Environments

The robot exploration task has been widely studied with applications spa...
research
11/17/2017

Metric Map Merging using RFID Tags & Topological Information

A map merging component is crucial for the proper functionality of a mul...

Please sign up or login with your details

Forgot password? Click here to reset