Meta-Learning Guarantees for Online Receding Horizon Control

10/21/2020
by   Deepan Muthirayan, et al.
0

In this paper we provide provable regret guarantees for an online meta-learning receding horizon control algorithm in an iterative control setting, where in each iteration the system to be controlled is a linear deterministic system that is different and unknown, the cost for the controller in an iteration is a general additive cost function and the control input is required to be constrained, which if violated incurs an additional cost. We prove (i) that the algorithm achieves a regret for the controller cost and constraint violation that are O(T^3/4) for an episode of duration T with respect to the best policy that satisfies the control input control constraints and (ii) that the average of the regret for the controller cost and constraint violation with respect to the same policy vary as O((1+1/√(N))T^3/4) with the number of iterations N, showing that the worst regret for the learning within an iteration continuously improves with experience of more iterations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2020

A Meta-Learning Control Algorithm with Provable Finite-Time Guarantees

In this work we provide provable regret guarantees for an online meta-le...
research
08/18/2022

Meta-Learning Online Control for Linear Dynamical Systems

In this paper, we consider the problem of finding a meta-learning online...
research
11/30/2021

Online Learning for Receding Horizon Control with Provable Regret Guarantees

We address the problem of learning to control an unknown linear dynamica...
research
08/04/2021

Regret Analysis of Learning-Based MPC with Partially-Unknown Cost Function

The exploration/exploitation trade-off is an inherent challenge in data-...
research
05/04/2021

Regret-Optimal Full-Information Control

We consider the infinite-horizon, discrete-time full-information control...
research
10/17/2022

Regret Bounds for Learning Decentralized Linear Quadratic Regulator with Partially Nested Information Structure

We study the problem of learning decentralized linear quadratic regulato...
research
03/21/2020

Learning in Networked Control Systems

We design adaptive controller (learning rule) for a networked control sy...

Please sign up or login with your details

Forgot password? Click here to reset