Mean Field Behaviour of Collaborative Multi-Agent Foragers

03/13/2021
by   Daniel Jarne Ornia, et al.
0

Collaborative multi-agent robotic systems where agents coordinate by modifying a shared environment often result in undesired dynamical couplings that complicate the analysis and experiments when solving a specific problem or task. Simultaneously, biologically-inspired robotics rely on simplifying agents and increasing their number to obtain more efficient solutions to such problems, drawing similarities with natural processes. In this work we focus on the problem of a biologically-inspired multi-agent system solving collaborative foraging. We show how mean field techniques can be used to re-formulate such a stochastic multi-agent problem into a deterministic autonomous system. This de-couples agent dynamics, enabling the computation of limit behaviours and the analysis of optimality guarantees. Furthermore, we analyse how having finite number of agents affects the performance when compared to the mean field limit and we discuss the implications of such limit approximations in this multi-agent system, which have impact on more general collaborative stochastic problems.

READ FULL TEXT

page 14

page 15

research
04/30/2021

Discrete-Time Mean Field Control with Environment States

Multi-agent reinforcement learning methods have shown remarkable potenti...
research
03/19/2023

Multi-Agent Reinforcement Learning via Mean Field Control: Common Noise, Major Agents and Approximation Properties

Recently, mean field control (MFC) has provided a tractable and theoreti...
research
02/10/2020

Q-Learning for Mean-Field Controls

Multi-agent reinforcement learning (MARL) has been applied to many chall...
research
02/28/2022

Can Mean Field Control (MFC) Approximate Cooperative Multi Agent Reinforcement Learning (MARL) with Non-Uniform Interaction?

Mean-Field Control (MFC) is a powerful tool to solve Multi-Agent Reinfor...
research
09/12/2022

Mean-Field Control Approach to Decentralized Stochastic Control with Finite-Dimensional Memories

Decentralized stochastic control (DSC) considers the optimal control pro...
research
10/04/2022

Robust feedback stabilization of interacting multi-agent systems under uncertainty

We consider control strategies for large-scale interacting agent systems...
research
09/08/2022

Mean Field Games on Weighted and Directed Graphs via Colored Digraphons

The field of multi-agent reinforcement learning (MARL) has made consider...

Please sign up or login with your details

Forgot password? Click here to reset