Safe Learning of Linear Time-Invariant Systems

11/01/2021
by   Farhad Farokhi, et al.
0

We consider safety in simultaneous learning and control of discrete-time linear time-invariant systems. We provide rigorous confidence bounds on the learned model of the system based on the number of utilized state measurements. These bounds are used to modify control inputs to the system via an optimization problem with potentially time-varying safety constraints. We prove that the state can only exit the safe set with small probability, provided a feasible solution to the safety-constrained optimization exists. This optimization problem is then reformulated in a more computationally-friendly format by tightening the safety constraints to account for model uncertainty during learning. The tightening decreases as the confidence in the learned model improves. We finally prove that, under persistence of excitation, the tightening becomes negligible as more measurements are gathered.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2021

Safe Learning of Uncertain Environments for Nonlinear Control-Affine Systems

In many learning based control methodologies, learning the unknown dynam...
research
03/22/2018

Linear model predictive safety certification for learning-based control

While it has been repeatedly shown that learning-based controllers can p...
research
10/04/2022

Safe and Stable Control Synthesis for Uncertain System Models via Distributionally Robust Optimization

This paper considers enforcing safety and stability of dynamical systems...
research
05/16/2022

Reachability Constrained Reinforcement Learning

Constrained reinforcement learning (CRL) has gained significant interest...
research
11/10/2022

Adaptive Real Time Exploration and Optimization for Safety-Critical Systems

We consider the problem of decision-making under uncertainty in an envir...
research
06/17/2023

Non-asymptotic System Identification for Linear Systems with Nonlinear Policies

This paper considers a single-trajectory system identification problem f...
research
11/01/2021

Safe Online Gain Optimization for Variable Impedance Control

Smooth behaviors are preferable for many contact-rich manipulation tasks...

Please sign up or login with your details

Forgot password? Click here to reset