DeepAI AI Chat
Log In Sign Up

Optimal Distributed Control of Multi-agent Systems in Contested Environments via Reinforcement Learning

by   Rohollah Moghadam, et al.

This paper presents a model-free reinforcement learning (RL) based distributed control protocol for leader-follower multi-agent systems. Although RL has been successfully used to learn optimal control protocols for multi-agent systems, the effects of adversarial inputs are ignored. It is shown in this paper, however, that their adverse effects can propagate across the network and impact the learning outcome of other intact agents. To alleviate this problem, a unified RL-based distributed control frameworks is developed for both homogeneous and heterogeneous multi-agent systems to prevent corrupted sensory data from propagating across the network. To this end, only the leader communicates its actual sensory information and other agents estimate the leader state using a distributed observer and communicate this estimation to their neighbors to achieve consensus on the leader state. The observer cannot be physically affected by any adversarial input. To further improve resiliency, distributed H-infinity control protocols are designed to attenuate the effect of the adversarial inputs on the compromised agent itself. An off-policy RL algorithm is developed to learn the solutions of the game algebraic Riccati equations arising from solving the H-infinity control problem. No knowledge of the agent dynamics is required and it is shown that the proposed RL-based H-infinity control protocol is resilient against adversarial inputs.


page 1

page 2

page 3

page 4


Resilient Autonomous Control of Distributed Multi-agent Systems in Contested Environments

An autonomous and resilient controller is proposed for leader-follower m...

Hybrid Information-driven Multi-agent Reinforcement Learning

Information theoretic sensor management approaches are an ideal solution...

Consensus Control for Leader-follower Multi-agent Systems under Prescribed Performance Guarantees

This paper addresses the problem of distributed control for leader-follo...

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

Multi-agent formation as well as obstacle avoidance is one of the most a...

Hierarchical Reinforcement Learning for Optimal Control of Linear Multi-Agent Systems: the Homogeneous Case

Individual agents in a multi-agent system (MAS) may have decoupled open-...

Fully-HeterogeneousContainment Control of a Network of Leader-Follower Systems

This paper develops a distributed solution to the fully-heterogeneous co...