Regret Analysis of Online Gradient Descent-based Iterative Learning Control with Model Mismatch

04/10/2022
by   Efe C. Balta, et al.
0

In Iterative Learning Control (ILC), a sequence of feedforward control actions is generated at each iteration on the basis of partial model knowledge and past measurements with the goal of steering the system toward a desired reference trajectory. This is framed here as an online learning task, where the decision-maker takes sequential decisions by solving a sequence of optimization problems having only partial knowledge of the cost functions. Having established this connection, the performance of an online gradient-descent based scheme using inexact gradient information is analyzed in the setting of dynamic and static regret, standard measures in online learning. Fundamental limitations of the scheme and its integration with adaptation mechanisms are further investigated, followed by numerical simulations on a benchmark ILC problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2010

Less Regret via Online Conditioning

We analyze and evaluate an online gradient descent algorithm with adapti...
research
07/21/2019

Alice's Adventures in the Markovian World

This paper proposes an algorithm Alice having no access to the physics l...
research
09/11/2019

Logarithmic Regret for Online Control

We study optimal regret bounds for control in linear dynamical systems u...
research
04/26/2019

Online Learning Algorithms for Quaternion ARMA Model

In this paper, we address the problem of adaptive learning for autoregre...
research
02/21/2018

Nonlinear Online Learning with Adaptive Nyström Approximation

Use of nonlinear feature maps via kernel approximation has led to succes...
research
12/01/2022

Learning for Control of Rolling ubots

Micron-scale robots (ubots) have recently shown great promise for emergi...
research
10/30/2018

An Online-Learning Approach to Inverse Optimization

In this paper, we demonstrate how to learn the objective function of a d...

Please sign up or login with your details

Forgot password? Click here to reset