Regret-optimal measurement-feedback control

11/24/2020
by   Gautam Goel, et al.
0

We consider measurement-feedback control in linear dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing an online controller which competes with the optimal dynamic sequence of control actions selected in hindsight, instead of the best controller in some specific class of controllers. This formulation of regret is attractive when the environment changes over time and no single controller achieves good performance over the entire time horizon. We show that in the measurement-feedback setting, unlike in the full-information setting, there is no single offline controller which outperforms every other offline controller on every disturbance, and propose a new H_2-optimal offline controller as a benchmark for the online controller to compete against. We show that the corresponding regret-optimal online controller can be found via a novel reduction to the classical Nehari problem from robust control and present a tight data-dependent bound on its regret.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/20/2020

Regret-optimal control in dynamic environments

We consider the control of linear time-varying dynamical systems from th...
research
07/28/2021

Competitive Control

We consider control from the perspective of competitive analysis. Unlike...
research
02/07/2020

The Power of Linear Controllers in LQR Control

The Linear Quadratic Regulator (LQR) framework considers the problem of ...
research
02/13/2020

Beyond No-Regret: Competitive Control via Online Optimization with Memory

This paper studies online control with adversarial disturbances using to...
research
09/20/2020

Safety-Critical Online Control with Adversarial Disturbances

This paper studies the control of safety-critical dynamical systems in t...
research
05/05/2018

Generalised Dining Philosophers as Feedback Control

We revisit the Generalised Dining Philosophers problem through the persp...
research
04/13/2023

A Distributionally Robust Approach to Regret Optimal Control using the Wasserstein Distance

This paper proposes a distributionally robust approach to regret optimal...

Please sign up or login with your details

Forgot password? Click here to reset