Sign-Perturbed Sums: A New System Identification Approach for Constructing Exact Non-Asymptotic Confidence Regions in Linear Regression Models

07/22/2018
by   Balázs Cs. Csáji, et al.
0

We propose a new system identification method, called Sign-Perturbed Sums (SPS), for constructing non-asymptotic confidence regions under mild statistical assumptions. SPS is introduced for linear regression models, including but not limited to FIR systems, and we show that the SPS confidence regions have exact confidence probabilities, i.e., they contain the true parameter with a user-chosen exact probability for any finite data set. Moreover, we also prove that the SPS regions are star convex with the Least-Squares (LS) estimate as a star center. The main assumptions of SPS are that the noise terms are independent and symmetrically distributed about zero, but they can be nonstationary, and their distributions need not be known. The paper also proposes a computationally efficient ellipsoidal outer approximation algorithm for SPS. Finally, SPS is demonstrated through a number of simulation experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/29/2023

Non-Asymptotic State-Space Identification of Closed-Loop Stochastic Linear Systems using Instrumental Variables

The paper suggests a generalization of the Sign-Perturbed Sums (SPS) fin...
research
12/23/2018

Uncertainty Quantification for Kernel Methods

We propose a data-driven approach to quantify the uncertainty of models ...
research
07/23/2018

Score Permutation Based Finite Sample Inference for Generalized AutoRegressive Conditional Heteroskedasticity (GARCH) Models

A standard model of (conditional) heteroscedasticity, i.e., the phenomen...
research
09/19/2016

Conformalized Kernel Ridge Regression

General predictive models do not provide a measure of confidence in pred...
research
11/07/2022

Constructing Exact Confidence Regions on Parameter Manifolds of Non-Linear Models

Using the mathematical framework of information geometry, we introduce a...
research
05/02/2022

Star-specific Key-homomorphic PRFs from Linear Regression and Extremal Set Theory

We introduce a novel method to derandomize the learning with errors (LWE...
research
11/09/2018

Median Confidence Regions in a Nonparametric Model

The problem of constructing confidence regions for the median in the non...

Please sign up or login with your details

Forgot password? Click here to reset