Are Latent Factor Regression and Sparse Regression Adequate?

03/02/2022
by   Jianqing Fan, et al.
2

We propose the Factor Augmented sparse linear Regression Model (FARM) that not only encompasses both the latent factor regression and sparse linear regression as special cases but also bridges dimension reduction and sparse regression together. We provide theoretical guarantees for the estimation of our model under the existence of sub-Gaussian and heavy-tailed noises (with bounded (1+x)-th moment, for all x>0), respectively. In addition, the existing works on supervised learning often assume the latent factor regression or the sparse linear regression is the true underlying model without justifying its adequacy. To fill in such an important gap, we also leverage our model as the alternative model to test the sufficiency of the latent factor regression and the sparse linear regression models. To accomplish these goals, we propose the Factor-Adjusted de-Biased Test (FabTest) and a two-stage ANOVA type test respectively. We also conduct large-scale numerical experiments including both synthetic and FRED macroeconomics data to corroborate the theoretical properties of our methods. Numerical results illustrate the robustness and effectiveness of our model against latent factor regression and sparse linear regression models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/17/2018

Minimax rate of testing in sparse linear regression

We consider the problem of testing the hypothesis that the parameter of ...
research
07/17/2023

An extended latent factor framework for ill-posed linear regression

The classical latent factor model for linear regression is extended by a...
research
01/09/2016

On Computationally Tractable Selection of Experiments in Measurement-Constrained Regression Models

We derive computationally tractable methods to select a small subset of ...
research
03/03/2011

Sparse Volterra and Polynomial Regression Models: Recoverability and Estimation

Volterra and polynomial regression models play a major role in nonlinear...
research
07/30/2023

Towards Practical Robustness Auditing for Linear Regression

We investigate practical algorithms to find or disprove the existence of...
research
10/23/2018

Heterogeneous large datasets integration using Bayesian factor regression

Two key challenges in modern statistical applications are the large amou...
research
07/25/2023

Tuning-free testing of factor regression against factor-augmented sparse alternatives

This study introduces a bootstrap test of the validity of factor regress...

Please sign up or login with your details

Forgot password? Click here to reset