Sampling-based Reactive Synthesis for Nondeterministic Hybrid Systems

04/14/2023
by   Qi Heng Ho, et al.
0

This paper introduces a sampling-based strategy synthesis algorithm for nondeterministic hybrid systems with complex continuous dynamics under temporal and reachability constraints. We view the evolution of the hybrid system as a two-player game, where the nondeterminism is an adversarial player whose objective is to prevent achieving temporal and reachability goals. The aim is to synthesize a winning strategy – a reactive (robust) strategy that guarantees the satisfaction of the goals under all possible moves of the adversarial player. The approach is based on growing a (search) game-tree in the hybrid space by combining a sampling-based planning method with a novel bandit-based technique to select and improve on partial strategies. We provide conditions under which the algorithm is probabilistically complete, i.e., if a winning strategy exists, the algorithm will almost surely find it. The case studies and benchmark results show that the algorithm is general and consistently outperforms the state of the art.

READ FULL TEXT

page 1

page 8

research
02/17/2020

Synthesis of Deceptive Strategies in Reachability Games with Action Misperception

We consider a class of two-player turn-based zero-sum games on graphs wi...
research
05/29/2021

Causality-Based Game Solving

We present a causality-based algorithm for solving two-player reachabili...
research
04/23/2021

Synthesis of Deceptive Strategies in Reachability Games with Action Misperception (Technical Report)

Strategic deception is an act of manipulating the opponent's perception ...
research
10/01/2014

Integrating active sensing into reactive synthesis with temporal logic constraints under partial observations

We introduce the notion of online reactive planning with sensing actions...
research
03/30/2022

Anticipatory Counterplanning

In competitive environments, commonly agents try to prevent opponents fr...
research
09/21/2022

Controller Synthesis for Timeline-based Games

In the timeline-based approach to planning, originally born in the space...
research
08/19/2021

Regstar: Efficient Strategy Synthesis for Adversarial Patrolling Games

We design a new efficient strategy synthesis method applicable to advers...

Please sign up or login with your details

Forgot password? Click here to reset