DeepAI AI Chat
Log In Sign Up

Cooperative Path Integral Control for Stochastic Multi-Agent Systems

by   Neng Wan, et al.
University of Illinois at Urbana-Champaign
University of Nevada, Reno
Georgia Institute of Technology

A distributed stochastic optimal control solution is presented for cooperative multi-agent systems. The network of agents is partitioned into multiple factorial subsystems, each of which consists of a central agent and neighboring agents. Local control actions that rely only on agents' local observations are designed to optimize the joint cost functions of subsystems. When solving for the local control actions, the joint optimality equation for each subsystem is cast as a linear partial differential equation and solved using the Feynman-Kac formula. The solution and the optimal control action are then formulated as path integrals and approximated by a Monte-Carlo method. Numerical verification is provided through a simulation example consisting of a team of cooperative UAVs.


page 1

page 2

page 3

page 4


Distributed Algorithms for Linearly-Solvable Optimal Control in Networked Multi-Agent Systems

Distributed algorithms for both discrete-time and continuous-time linear...

Safety Embedded Stochastic Optimal Control of Networked Multi-Agent Systems via Barrier States

This paper presents a safe stochastic optimal control method for network...

Zeroth-Order Feedback Optimization for Cooperative Multi-Agent Systems

We study a class of cooperative multi-agent optimization problems, where...

Surrogate Optimal Control for Strategic Multi-Agent Systems

This paper studies how to design a platform to optimally control constra...

Optimal Stationary Synchronization of Heterogeneous Linear Multi-Agent Systems

Based on an approach with bounded virtual exosystems, the output synchro...

Compositionality of Linearly Solvable Optimal Control in Networked Multi-Agent Systems

In this paper, we discuss the methodology of generalizing the optimal co...

Mean-Field Control Approach to Decentralized Stochastic Control with Finite-Dimensional Memories

Decentralized stochastic control (DSC) considers the optimal control pro...