Active Learning for Identification of Linear Dynamical Systems

02/02/2020
by   Andrew Wagenmaker, et al.
0

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound quantifying the estimation rate our algorithm attains and prove matching upper and lower bounds which guarantee its asymptotic optimality, up to constants. In addition, we show that this optimal rate is unattainable when using Gaussian noise to excite the system, even with optimally tuned covariance, and analyze several examples where our algorithm provably improves over rates obtained by playing noise. Our analysis critically relies on a novel result quantifying the error in estimating the parameters of a dynamical system when arbitrary periodic inputs are being played. We conclude with numerical examples that illustrate the effectiveness of our algorithm in practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2020

Active Learning for Nonlinear System Identification with Guarantees

While the identification of nonlinear dynamical systems is a fundamental...
research
02/02/2019

Learning Linear Dynamical Systems with Semi-Parametric Least Squares

We analyze a simple prefiltered variation of the least squares estimator...
research
06/02/2022

Dynamic Structure Estimation from Bandit Feedback

This work present novel method for structure estimation of an underlying...
research
11/19/2020

Improved rates for identification of partially observed linear dynamical systems

Identification of a linear time-invariant dynamical system from partial ...
research
02/10/2021

Task-Optimal Exploration in Linear Dynamical Systems

Exploration in unknown environments is a fundamental problem in reinforc...
research
03/27/2020

Closed-loop Parameter Identification of Linear Dynamical Systems through the Lens of Feedback Channel Coding Theory

This paper considers the problem of closed-loop identification of linear...
research
01/19/2022

Localization and Estimation of Unknown Forced Inputs: A Group LASSO Approach

We model and study the problem of localizing a set of sparse forcing inp...

Please sign up or login with your details

Forgot password? Click here to reset