Adapting the Exploration-Exploitation Balance in Heterogeneous Swarms: Tracking Evasive Targets

07/27/2022
by   Hian Lee Kwa, et al.
0

There has been growing interest in the use of multi-robot systems in various tasks and scenarios. The main attractiveness of such systems is their flexibility, robustness, and scalability. An often overlooked yet promising feature is system modularity, which offers the possibility to harness agent specialization, while also enabling system-level upgrades. However, altering the agents' capacities can change the exploration-exploitation balance required to maximize the system's performance. Here, we study the effect of a swarm's heterogeneity on its exploration-exploitation balance while tracking multiple fast-moving evasive targets under the Cooperative Multi-Robot Observation of Multiple Moving Targets framework. To this end, we use a decentralized search and tracking strategy with adjustable levels of exploration and exploitation. By indirectly tuning the balance, we first confirm the presence of an optimal balance between these two key competing actions. Next, by substituting slower moving agents with faster ones, we show that the system exhibits a performance improvement without any modifications to the original strategy. In addition, owing to the additional amount of exploitation carried out by the faster agents, we demonstrate that a heterogeneous system's performance can be further improved by reducing an agent's level of connectivity, to favor the conduct of exploratory actions. Furthermore, in studying the influence of the density of swarming agents, we show that the addition of faster agents can counterbalance a reduction in the overall number of agents while maintaining the level of tracking performance. Finally, we explore the challenges of using differentiated strategies to take advantage of the heterogeneous nature of the swarm.

READ FULL TEXT
research
08/16/2021

Tracking Multiple Fast Targets With Swarms: Interplay Between Social Interaction and Agent Memory

The task of searching for and tracking of multiple targets is a challeng...
research
08/03/2020

Heterogeneous Swarms for Maritime Dynamic Target Search and Tracking

Current strategies employed for maritime target search and tracking are ...
research
09/19/2013

Exploration and Exploitation in Visuomotor Prediction of Autonomous Agents

This paper discusses various techniques to let an agent learn how to pre...
research
01/25/2023

Effect of Swarm Density on Collective Tracking Performance

How does the size of a swarm affect its collective action? Despite being...
research
12/05/2020

Exploration-Exploitation in Multi-Agent Learning: Catastrophe Theory Meets Game Theory

Exploration-exploitation is a powerful and practical tool in multi-agent...
research
02/13/2020

Cooperative Observation of Targets moving over a Planar Graph with Prediction of Positions

Consider a team with two types of agents: targets and observers. Observe...
research
05/13/2021

An Upper Confidence Bound for Simultaneous Exploration and Exploitation in Heterogeneous Multi-Robot Systems

Heterogeneous multi-robot systems are advantageous for operations in unk...

Please sign up or login with your details

Forgot password? Click here to reset