Dealing with collinearity in large-scale linear system identification using Bayesian regularization

by   Wenqi Cao, et al.

We consider the identification of large-scale linear and stable dynamic systems whose outputs may be the result of many correlated inputs. Hence, severe ill-conditioning may affect the estimation problem. This is a scenario often arising when modeling complex physical systems given by the interconnection of many sub-units where feedback and algebraic loops can be encountered. We develop a strategy based on Bayesian regularization where any impulse response is modeled as the realization of a zero-mean Gaussian process. The stable spline covariance is used to include information on smooth exponential decay of the impulse responses. We then design a new Markov chain Monte Carlo scheme that deals with collinearity and is able to efficiently reconstruct the posterior of the impulse responses. It is based on a variation of Gibbs sampling which updates possibly overlapping blocks of the parameter space on the basis of the level of collinearity affecting the different inputs. Numerical experiments are included to test the goodness of the approach where hundreds of impulse responses form the system and inputs correlation may be very high.


page 5

page 6


Dealing with Collinearity in Large-Scale Linear System Identification Using Gaussian Regression

Many problems arising in control require the determination of a mathemat...

Estimation of sparse linear dynamic networks using the stable spline horseshoe prior

Identification of the so-called dynamic networks is one of the most chal...

Outlier robust system identification: a Bayesian kernel-based approach

In this paper, we propose an outlier-robust regularized kernel-based met...

Identification of complex systems in the basis of wavelets

In this paper is proposed the method of the identification of complex dy...

Bayesian kernel-based system identification with quantized output data

In this paper we introduce a novel method for linear system identificati...

Please sign up or login with your details

Forgot password? Click here to reset