An Efficient Bayesian Robust Principal Component Regression

11/16/2017
by   Philippe Gagnon, et al.
0

Principal component regression is a linear regression model with principal components as regressors. This type of modelling is particularly useful for prediction in settings with high-dimensional covariates. Surprisingly, the existing literature treating of Bayesian approaches is relatively sparse. In this paper, we aim at filling some gaps through the following practical contribution: we introduce a Bayesian approach with detailed guidelines for a straightforward implementation. The approach features two characteristics that we believe are important. First, it effectively involves the relevant principal components in the prediction process. This is achieved in two steps. The first one is model selection; the second one is to average out the predictions obtained from the selected models according to model averaging mechanisms, allowing to account for model uncertainty. The model posterior probabilities are required for model selection and model averaging. For this purpose, we include a procedure leading to an efficient reversible jump algorithm. The second characteristic of our approach is whole robustness, meaning that the impact of outliers on inference gradually vanishes as they approach plus or minus infinity. The conclusions obtained are consequently consistent with the majority of observations (the bulk of the data).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2019

Robust Function-on-Function Regression

Functional linear regression is a widely used approach to model function...
research
02/26/2014

Sparse principal component regression with adaptive loading

Principal component regression (PCR) is a two-stage procedure that selec...
research
06/04/2019

How many variables should be entered in a principal component regression equation?

We study least squares linear regression over N uncorrelated Gaussian fe...
research
11/09/2021

Function-on-function linear quantile regression

In this study, we propose a function-on-function linear quantile regress...
research
07/03/2018

cvBMS and cvBMA: filling in the gaps

With this technical report, we provide mathematical and implementational...
research
11/24/2017

Predicting shim gaps in aircraft assembly with machine learning and sparse sensing

A modern aircraft may require on the order of thousands of custom shims ...
research
07/20/2020

Prediction in latent factor regression: Adaptive PCR and beyond

This work is devoted to the finite sample prediction risk analysis of a ...

Please sign up or login with your details

Forgot password? Click here to reset