Learning the Dynamics of Autonomous Linear Systems From Multiple Trajectories

03/24/2022
by   Lei Xin, et al.
0

We consider the problem of learning the dynamics of autonomous linear systems (i.e., systems that are not affected by external control inputs) from observations of multiple trajectories of those systems, with finite sample guarantees. Existing results on learning rate and consistency of autonomous linear system identification rely on observations of steady state behaviors from a single long trajectory, and are not applicable to unstable systems. In contrast, we consider the scenario of learning system dynamics based on multiple short trajectories, where there are no easily observed steady state behaviors. We provide a finite sample analysis, which shows that the dynamics can be learned at a rate 𝒪(1/√(N)) for both stable and unstable systems, where N is the number of trajectories, when the initial state of the system has zero mean (which is a common assumption in the existing literature). We further generalize our result to the case where the initial state has non-zero mean. We show that one can adjust the length of the trajectories to achieve a learning rate of 𝒪(√(logN/N)) for strictly stable systems and a learning rate of 𝒪((logN)^d/√(N)) for marginally stable systems, where d is some constant.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2023

Learning Linearized Models from Nonlinear Systems with Finite Data

Identifying a linear system model from data has wide applications in con...
research
03/31/2022

Learning from many trajectories

We initiate a study of supervised learning from many independent sequenc...
research
06/16/2019

Characterizing the Exact Behaviors of Temporal Difference Learning Algorithms Using Markov Jump Linear System Theory

In this paper, we provide a unified analysis of temporal difference lear...
research
04/21/2022

Model-free Learning of Regions of Attraction via Recurrent Sets

We consider the problem of learning an inner approximation of the region...
research
04/03/2023

Learning Personalized Models with Clustered System Identification

We address the problem of learning linear system models from observing m...
research
03/03/2023

A Finite-Sample Analysis of Payoff-Based Independent Learning in Zero-Sum Stochastic Games

We study two-player zero-sum stochastic games, and propose a form of ind...
research
02/08/2023

Learning Dynamical Systems by Leveraging Data from Similar Systems

We consider the problem of learning the dynamics of a linear system when...

Please sign up or login with your details

Forgot password? Click here to reset