On stochastic stabilization via non-smooth control Lyapunov functions

05/26/2022
by   Pavel Osinenko, et al.
0

Control Lyapunov function is a central tool in stabilization. It generalizes an abstract energy function – a Lyapunov function – to the case of controlled systems. It is a known fact that most control Lyapunov functions are non-smooth – so is the case in non-holonomic systems, like wheeled robots and cars. Frameworks for stabilization using non-smooth control Lyapunov functions exist, like Dini aiming and steepest descent. This work generalizes the related results to the stochastic case. As the groundwork, sampled control scheme is chosen in which control actions are computed at discrete moments in time using discrete measurements of the system state. In such a setup, special attention should be paid to the sample-to-sample behavior of the control Lyapunov function. A particular challenge here is a random noise acting on the system. The central result of this work is a theorem that states, roughly, that if there is a, generally non-smooth, control Lyapunov function, the given stochastic dynamical system can be practically stabilized in the sample-and-hold mode meaning that the control actions are held constant within sampling time steps. A particular control method chosen is based on Moreau-Yosida regularization, in other words, inf-convolution of the control Lyapunov function, but the overall framework is extendable to further control schemes. It is assumed that the system noise be bounded almost surely, although the case of unbounded noise is briefly addressed.

READ FULL TEXT

page 1

page 14

research
07/01/2020

Bandit Linear Control

We consider the problem of controlling a known linear dynamical system u...
research
02/13/2023

Beyond Uniform Smoothness: A Stopped Analysis of Adaptive SGD

This work considers the problem of finding a first-order stationary poin...
research
01/31/2016

A Proximal Stochastic Quasi-Newton Algorithm

In this paper, we discuss the problem of minimizing the sum of two conve...
research
01/16/2023

Asymptotic normality and optimality in nonsmooth stochastic approximation

In their seminal work, Polyak and Juditsky showed that stochastic approx...
research
09/16/2019

Sinkhorn Algorithm as a Special Case of Stochastic Mirror Descent

We present a new perspective on the celebrated Sinkhorn algorithm by sho...
research
03/22/2022

Gradient flows and randomised thresholding: sparse inversion and classification

Sparse inversion and classification problems are ubiquitous in modern da...

Please sign up or login with your details

Forgot password? Click here to reset