Dynamic Size Message Scheduling for Multi-Agent Communication under Limited Bandwidth

06/16/2023
by   Qingshuang Sun, et al.
0

Communication plays a vital role in multi-agent systems, fostering collaboration and coordination. However, in real-world scenarios where communication is bandwidth-limited, existing multi-agent reinforcement learning (MARL) algorithms often provide agents with a binary choice: either transmitting a fixed number of bytes or no information at all. This limitation hinders the ability to effectively utilize the available bandwidth. To overcome this challenge, we present the Dynamic Size Message Scheduling (DSMS) method, which introduces a finer-grained approach to scheduling by considering the actual size of the information to be exchanged. Our contribution lies in adaptively adjusting message sizes using Fourier transform-based compression techniques, enabling agents to tailor their messages to match the allocated bandwidth while striking a balance between information loss and transmission efficiency. Receiving agents can reliably decompress the messages using the inverse Fourier transform. Experimental results demonstrate that DSMS significantly improves performance in multi-agent cooperative tasks by optimizing the utilization of bandwidth and effectively balancing information value.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/10/2020

Event-Triggered Multi-agent Reinforcement Learning with Communication under Limited-bandwidth Constraint

Communicating with each other in a distributed manner and behaving as a ...
research
12/03/2019

Learning Agent Communication under Limited Bandwidth by Message Pruning

Communication is a crucial factor for the big multi-agent world to stay ...
research
12/20/2021

Multi-agent Communication with Graph Information Bottleneck under Limited Bandwidth

Recent studies have shown that introducing communication between agents ...
research
02/19/2023

Efficient Communication via Self-supervised Information Aggregation for Online and Offline Multi-agent Reinforcement Learning

Utilizing messages from teammates can improve coordination in cooperativ...
research
08/10/2022

Diversifying Message Aggregation in Multi-Agent Communication via Normalized Tensor Nuclear Norm Regularization

Aggregating messages is a key component for the communication of multi-a...
research
02/17/2021

Distributed Fair Scheduling for Information Exchange in Multi-Agent Systems

Information exchange is a crucial component of many real-world multi-age...
research
11/30/2022

Towards True Lossless Sparse Communication in Multi-Agent Systems

Communication enables agents to cooperate to achieve their goals. Learni...

Please sign up or login with your details

Forgot password? Click here to reset