Input-to-State Stability in Probability

04/28/2023
by   Preston Culbertson, et al.
0

Input-to-State Stability (ISS) is fundamental in mathematically quantifying how stability degrades in the presence of bounded disturbances. If a system is ISS, its trajectories will remain bounded, and will converge to a neighborhood of an equilibrium of the undisturbed system. This graceful degradation of stability in the presence of disturbances describes a variety of real-world control implementations. Despite its utility, this property requires the disturbance to be bounded and provides invariance and stability guarantees only with respect to this worst-case bound. In this work, we introduce the concept of “ISS in probability (ISSp)” which generalizes ISS to discrete-time systems subject to unbounded stochastic disturbances. Using tools from martingale theory, we provide Lyapunov conditions for a system to be exponentially ISSp, and connect ISSp to stochastic stability conditions found in literature. We exemplify the utility of this method through its application to a bipedal robot confronted with step heights sampled from a truncated Gaussian distribution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2023

Stability Bounds for Learning-Based Adaptive Control of Discrete-Time Multi-Dimensional Stochastic Linear Systems with Input Constraints

We consider the problem of adaptive stabilization for discrete-time, mul...
research
06/07/2020

On forward invariance in Lyapunov stability theorem for local stability

Forward invariance of a basin of attraction is often overlooked when usi...
research
08/25/2020

Robust Reinforcement Learning: A Case Study in Linear Quadratic Regulation

This paper studies the robustness aspect of reinforcement learning algor...
research
10/01/2020

Robust Model-Free Learning and Control without Prior Knowledge

We present a simple model-free control algorithm that is able to robustl...
research
10/12/2020

Quantitative stability and numerical analysis of Markovian quadratic BSDEs with reflection

We study quantitative stability of the solutions to Markovian quadratic ...
research
01/19/2022

Stability of Deep Neural Networks via discrete rough paths

Using rough path techniques, we provide a priori estimates for the outpu...
research
11/27/2018

Chasing the Echo State Property

Reservoir Computing (RC) provides an efficient way for designing dynamic...

Please sign up or login with your details

Forgot password? Click here to reset