Adaptive Neighborhood Resizing for Stochastic Reachability in Multi-Agent Systems

05/21/2018
by   Anna Lukina, et al.
0

We present DAMPC, a distributed, adaptive-horizon and adaptive-neighborhood algorithm for solving the stochastic reachability problem in multi-agent systems, in particular flocking modeled as a Markov decision process. At each time step, every agent calls a centralized, adaptive-horizon model-predictive control (AMPC) algorithm to obtain an optimal solution for its local neighborhood. Second, the agents derive the flock-wide optimal solution through a sequence of consensus rounds. Third, the neighborhood is adaptively resized using a flock-wide, cost-based Lyapunov function V. This way DAMPC improves efficiency without compromising convergence. We evaluate DAMPC's performance using statistical model checking. Our results demonstrate that, compared to AMPC, DAMPC achieves considerable speed-up (two-fold in some cases) with only a slightly lower rate of convergence. The smaller average neighborhood size and lookahead horizon demonstrate the benefits of the DAMPC approach for stochastic reachability problems involving any controllable multi-agent system that possesses a cost function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2018

A Distributed Stochastic Gradient Tracking Method

In this paper, we study the problem of distributed multi-agent optimizat...
research
05/25/2018

Distributed Stochastic Gradient Tracking Methods

In this paper, we study the problem of distributed multi-agent optimizat...
research
02/20/2020

V-Formation via Model Predictive Control

We present recent results that demonstrate the power of viewing the prob...
research
11/06/2021

Distributed stochastic proximal algorithm with random reshuffling for non-smooth finite-sum optimization

The non-smooth finite-sum minimization is a fundamental problem in machi...
research
05/17/2023

Set-Membership Filtering-Based Cooperative State Estimation for Multi-Agent Systems

In this article, we focus on the cooperative state estimation problem of...
research
05/20/2022

Random Coordinate Descent for Resource Allocation in Open Multi-Agent Systems

We analyze the distributed random coordinate descent algorithm for solvi...
research
05/14/2018

Maximizing Expected Impact in an Agent Reputation Network -- Technical Report

Many multi-agent systems (MASs) are situated in stochastic environments....

Please sign up or login with your details

Forgot password? Click here to reset