Guessing Winning Policies in LTL Synthesis by Semantic Learning

05/24/2023
by   Jan Křetínský, et al.
0

We provide a learning-based technique for guessing a winning strategy in a parity game originating from an LTL synthesis problem. A cheaply obtained guess can be useful in several applications. Not only can the guessed strategy be applied as best-effort in cases where the game's huge size prohibits rigorous approaches, but it can also increase the scalability of rigorous LTL synthesis in several ways. Firstly, checking whether a guessed strategy is winning is easier than constructing one. Secondly, even if the guess is wrong in some places, it can be fixed by strategy iteration faster than constructing one from scratch. Thirdly, the guess can be used in on-the-fly approaches to prioritize exploration in the most fruitful directions. In contrast to previous works, we (i) reflect the highly structured logical information in game's states, the so-called semantic labelling, coming from the recent LTL-to-automata translations, and (ii) learn to reflect it properly by learning from previously solved games, bringing the solving process closer to human-like reasoning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/22/2019

Semantic Labelling and Learning for Parity Game Solving in LTL Synthesis

We propose "semantic labelling" as a novel ingredient for solving games ...
research
11/29/2017

Symbolic vs. Bounded Synthesis for Petri Games

Petri games are a multiplayer game model for the automatic synthesis of ...
research
03/29/2019

Practical Synthesis of Reactive Systems from LTL Specifications via Parity Games

The synthesis - the automatic construction - of reactive systems from li...
research
01/24/2022

On-The-Fly Solving for Symbolic Parity Games

Parity games can be used to represent many different kinds of decision p...
research
07/01/2019

Translating Asynchronous Games for Distributed Synthesis (Full Version)

In distributed synthesis, we generate a set of process implementations t...
research
08/29/2023

LTLf Best-Effort Synthesis in Nondeterministic Planning Domains

We study best-effort strategies (aka plans) in fully observable nondeter...
research
07/05/2018

Surprising strategies obtained by stochastic optimization in partially observable games

This paper studies the optimization of strategies in the context of poss...

Please sign up or login with your details

Forgot password? Click here to reset