Optimistic robust linear quadratic dual control

12/31/2019
by   Jack Umenberger, et al.
0

Recent work by Mania et al. has proved that certainty equivalent control achieves nearly optimal regret for linear systems with quadratic costs. However, when parameter uncertainty is large, certainty equivalence cannot be relied upon to stabilize the true, unknown system. In this paper, we present a dual control strategy that attempts to combine the performance of certainty equivalence, with the practical utility of robustness. The formulation preserves structure in the representation of parametric uncertainty, which allows the controller to target reduction of uncertainty in the parameters that `matter most' for the control task, while robustly stabilizing the uncertain system. Control synthesis proceeds via convex optimization, and the method is illustrated on a numerical example.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2019

Certainty Equivalent Control of LQR is Efficient

We study the performance of the certainty equivalent controller on the L...
research
10/04/2017

On the Sample Complexity of the Linear Quadratic Regulator

This paper addresses the optimal control problem known as the Linear Qua...
research
06/04/2019

Robust exploration in linear quadratic reinforcement learning

This paper concerns the problem of learning control policies for an unkn...
research
05/17/2021

Probabilistic robust linear quadratic regulators with Gaussian processes

Probabilistic models such as Gaussian processes (GPs) are powerful tools...
research
02/24/2020

Robust Learning-Based Control via Bootstrapped Multiplicative Noise

Despite decades of research and recent progress in adaptive control and ...
research
05/26/2021

Certainty Equivalent Quadratic Control for Markov Jump Systems

Real-world control applications often involve complex dynamics subject t...
research
09/10/2019

Convex Controller Synthesis for Contact

Controlling contacts is truly challenging, and this has been a major hur...

Please sign up or login with your details

Forgot password? Click here to reset