Barrier Functions for Multiagent-POMDPs with DTL Specifications

03/19/2020
by   Mohamadreza Ahmadi, et al.
0

Multi-agent partially observable Markov decision processes (MPOMDPs) provide a framework to represent heterogeneous autonomous agents subject to uncertainty and partial observation. In this paper, given a nominal policy provided by a human operator or a conventional planning method, we propose a technique based on barrier functions to design a minimally interfering safety-shield ensuring satisfaction of high-level specifications in terms of linear distribution temporal logic (LDTL). To this end, we use sufficient and necessary conditions for the invariance of a given set based on discrete-time barrier functions (DTBFs) and formulate sufficient conditions for finite time DTBF to study finite time convergence to a set. We then show that different LDTL mission/safety specifications can be cast as a set of invariance or finite time reachability problems. We demonstrate that the proposed method for safety-shield synthesis can be implemented online by a sequence of one-step greedy algorithms. We demonstrate the efficacy of the proposed method using experiments involving a team of robots.

READ FULL TEXT
research
03/19/2019

Safe Policy Synthesis in Multi-Agent POMDPs via Discrete-Time Barrier Functions

A multi-agent partially observable Markov decision process (MPOMDP) is a...
research
08/07/2018

Control of Multi-Agent Systems with Finite Time Control Barrier Certificates and Temporal Logic

In this paper, a method to synthesize controllers using finite time conv...
research
08/14/2019

Control Of Mobile Robots Using Barrier Functions Under Temporal Logic Specifications

In this paper, we propose a framework for the control of mobile robots s...
research
02/27/2018

Human-in-the-Loop Synthesis for Partially Observable Markov Decision Processes

We study planning problems where autonomous agents operate inside enviro...
research
03/08/2022

Distributed Control using Reinforcement Learning with Temporal-Logic-Based Reward Shaping

We present a computational framework for synthesis of distributed contro...
research
12/30/2021

Risk-Bounded Control with Kalman Filtering and Stochastic Barrier Functions

In this paper, we study Stochastic Control Barrier Functions (SCBFs) to ...
research
09/24/2020

Recurrent Neural Network Controllers for Signal Temporal Logic Specifications Subject to Safety Constraints

We propose a framework based on Recurrent Neural Networks (RNNs) to dete...

Please sign up or login with your details

Forgot password? Click here to reset