Attack Impact Evaluation by Exact Convexification through State Space Augmentation

03/31/2022
by   Hampei Sasahara, et al.
0

We address the attack impact evaluation problem for control system security. We formulate the problem as a Markov decision process with a temporally joint chance constraint that forces the adversary to avoid being detected throughout the considered time period. Owing to the joint constraint, the optimal control policy depends not only on the current state but also on the entire history, which leads to the explosion of the search space and makes the problem generally intractable. It is shown that whether an alarm has been triggered or not, in addition to the current state is sufficient for specifying the optimal decision at each time step. Augmentation of the information to the state space induces an equivalent convex optimization problem, which is tractable using standard solvers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2023

Attack Impact Evaluation for Stochastic Control Systems through Alarm Flag State Augmentation

This note addresses the problem of evaluating the impact of an attack on...
research
02/27/2014

Linear Programming for Large-Scale Markov Decision Problems

We consider the problem of controlling a Markov decision process (MDP) w...
research
01/06/2019

Large-Scale Markov Decision Problems via the Linear Programming Dual

We consider the problem of controlling a fully specified Markov decision...
research
05/08/2018

Deception in Optimal Control

In this paper, we consider an adversarial scenario where one agent seeks...
research
12/29/2017

Characterizing optimal hierarchical policy inference on graphs via non-equilibrium thermodynamics

Hierarchies are of fundamental interest in both stochastic optimal contr...
research
12/16/2018

Incremental Observer Reduction Applied to Opacity Verification and Synthesis

With the proliferation of communication networks and mobile devices, the...
research
03/12/2021

On Incorporating Forecasts into Linear State Space Model Markov Decision Processes

Weather forecast information will very likely find increasing applicatio...

Please sign up or login with your details

Forgot password? Click here to reset