Competitive Control

07/28/2021
by   Gautam Goel, et al.
2

We consider control from the perspective of competitive analysis. Unlike much prior work on learning-based control, which focuses on minimizing regret against the best controller selected in hindsight from some specific class, we focus on designing an online controller which competes against a clairvoyant offline optimal controller. A natural performance metric in this setting is competitive ratio, which is the ratio between the cost incurred by the online controller and the cost incurred by the offline optimal controller. Using operator-theoretic techniques from robust control, we derive a computationally efficient state-space description of the the controller with optimal competitive ratio in both finite-horizon and infinite-horizon settings. We extend competitive control to nonlinear systems using Model Predictive Control (MPC) and present numerical experiments which show that our competitive controller can significantly outperform standard H_2 and H_∞ controllers in the MPC setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2020

Regret-optimal measurement-feedback control

We consider measurement-feedback control in linear dynamical systems fro...
research
02/13/2020

Beyond No-Regret: Competitive Control via Online Optimization with Memory

This paper studies online control with adversarial disturbances using to...
research
08/04/2021

Regret Analysis of Learning-Based MPC with Partially-Unknown Cost Function

The exploration/exploitation trade-off is an inherent challenge in data-...
research
04/06/2023

Computationally-efficient Motion Cueing Algorithm via Model Predictive Control

Driving simulators have been used in the automotive industry for many ye...
research
01/07/2018

Time-projection control to recover inter-sample disturbances, application to bipedal walking control

We present a new walking controller based on 3LP, a 3D model of bipedal ...
research
03/03/2020

ABC-LMPC: Safe Sample-Based Learning MPC for Stochastic Nonlinear Dynamical Systems with Adjustable Boundary Conditions

Sample-based learning model predictive control (LMPC) strategies have re...
research
11/21/2022

Best of Both Worlds in Online Control: Competitive Ratio and Policy Regret

We consider the fundamental problem of online control of a linear dynami...

Please sign up or login with your details

Forgot password? Click here to reset