Log In Sign Up

Compositionality of Linearly Solvable Optimal Control in Networked Multi-Agent Systems

by   Lin Song, et al.

In this paper, we discuss the methodology of generalizing the optimal control law from learned component tasks to unlearned composite tasks on Multi-Agent Systems (MASs), by using the linearity composition principle of linearly solvable optimal control (LSOC) problems. The proposed approach achieves both the compositionality and optimality of control actions simultaneously within the cooperative MAS framework in both discrete- and continuous-time in a sample-efficient manner, which reduces the burden of re-computation of the optimal control solutions for the new task on the MASs. We investigate the application of the proposed approach on the MAS with coordination between agents. The experiments show feasible results in investigated scenarios, including both discrete and continuous dynamical systems for task generalization without resampling.


page 1

page 2

page 3

page 4


Distributed Algorithms for Linearly-Solvable Optimal Control in Networked Multi-Agent Systems

Distributed algorithms for both discrete-time and continuous-time linear...

Safety Embedded Stochastic Optimal Control of Networked Multi-Agent Systems via Barrier States

This paper presents a safe stochastic optimal control method for network...

Cooperative Tuning of Multi-Agent Optimal Control Systems

This paper investigates the problem of cooperative tuning of multi-agent...

Cooperative Path Integral Control for Stochastic Multi-Agent Systems

A distributed stochastic optimal control solution is presented for coope...

Optimal Control for Structurally Sparse Systems using Graphical Inference

Dynamical systems with a distributed yet interconnected structure, like ...

Computing Optimal Control of Cascading Failure in DC Networks

We consider discrete-time dynamics, for cascading failure in DC networks...

Discontinuity-Sensitive Optimal Control Learning by Mixture of Experts

This paper proposes a discontinuity-sensitive approach to learn the solu...