Closed-loop Parameter Identification of Linear Dynamical Systems through the Lens of Feedback Channel Coding Theory

03/27/2020
by   Ali Reza Pedram, et al.
0

This paper considers the problem of closed-loop identification of linear scalar systems with Gaussian process noise, where the system input is determined by a deterministic state feedback policy. The regularized least-square estimate (LSE) algorithm is adopted, seeking to find the best estimate of unknown model parameters based on noiseless measurements of the state. We are interested in the fundamental limitation of the rate at which unknown parameters can be learned, in the sense of the D-optimality scalarization criterion subject to a quadratic control cost. We first establish a novel connection between a closed-loop identification problem of interest and a channel coding problem involving an additive white Gaussian noise (AWGN) channel with feedback and a certain structural constraint. Based on this connection, we show that the learning rate is fundamentally upper bounded by the capacity of the corresponding AWGN channel. Although the optimal design of the feedback policy remains challenging, we derive conditions under which the upper bound is achieved. Finally, we show that the obtained upper bound implies that super-linear convergence is unattainable for any choice of the policy.

READ FULL TEXT
research
12/15/2017

Improved Target Acquisition Rates with Feedback Codes

This paper considers the problem of acquiring an unknown target location...
research
04/14/2022

A Feedback Capacity-Achieving Coding Scheme for the (d,∞)-RLL Input-Constrained Binary Erasure Channel

This paper considers the memoryless input-constrained binary erasure cha...
research
08/26/2021

Finite-time System Identification and Adaptive Control in Autoregressive Exogenous Systems

Autoregressive exogenous (ARX) systems are the general class of input-ou...
research
03/30/2021

Learning Robust Feedback Policies from Demonstrations

In this work we propose and analyze a new framework to learn feedback co...
research
07/21/2022

Feedback capacity of Gaussian channels with memory

We consider the feedback capacity of a MIMO channel whose channel output...
research
02/02/2020

Active Learning for Identification of Linear Dynamical Systems

We propose an algorithm to actively estimate the parameters of a linear ...
research
09/15/2022

Learning-Based Adaptive Control for Stochastic Linear Systems with Input Constraints

We propose a certainty-equivalence scheme for adaptive control of scalar...

Please sign up or login with your details

Forgot password? Click here to reset