Certainty Equivalent Quadratic Control for Markov Jump Systems

05/26/2021
by   Zhe Du, et al.
0

Real-world control applications often involve complex dynamics subject to abrupt changes or variations. Markov jump linear systems (MJS) provide a rich framework for modeling such dynamics. Despite an extensive history, theoretical understanding of parameter sensitivities of MJS control is somewhat lacking. Motivated by this, we investigate robustness aspects of certainty equivalent model-based optimal control for MJS with quadratic cost function. Given the uncertainty in the system matrices and in the Markov transition matrix is bounded by ϵ and η respectively, robustness results are established for (i) the solution to coupled Riccati equations and (ii) the optimal cost, by providing explicit perturbation bounds which decay as 𝒪(ϵ + η) and 𝒪((ϵ + η)^2) respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2019

Certainty Equivalent Control of LQR is Efficient

We study the performance of the certainty equivalent controller on the L...
research
11/13/2021

Identification and Adaptive Control of Markov Jump Systems: Sample Complexity and Regret Bounds

Learning how to effectively control unknown dynamical systems is crucial...
research
10/14/2021

Preconditioners for robust optimal control problems under uncertainty

The discretization of robust quadratic optimal control problems under un...
research
10/21/2020

Markov Data-Based Reference Tracking of Tensegrity Morphing Airfoils

This letter presents a data-based control design for reference tracking ...
research
11/17/2021

On the Effectiveness of Iterative Learning Control

Iterative learning control (ILC) is a powerful technique for high perfor...
research
11/20/2017

Finite Time Analysis of Optimal Adaptive Policies for Linear-Quadratic Systems

We consider the classical problem of control of linear systems with quad...
research
12/31/2019

Optimistic robust linear quadratic dual control

Recent work by Mania et al. has proved that certainty equivalent control...

Please sign up or login with your details

Forgot password? Click here to reset