DeepAI

# A note on the prediction error of principal component regression in high dimensions

We analyze the prediction error of principal component regression (PCR) and prove high probability bounds for the corresponding squared risk conditional on the design. Our results show that if an effective rank condition holds, then PCR performs comparably to the oracle method obtained by replacing empirical principal components by their population counterparts. On the other hand, if this condition is violated, then empirical eigenvalues start to have a significant upward bias, resulting in a self-induced regularization of PCR. Our approach relies on the behavior of empirical eigenvalues, empirical eigenvectors and the excess risk of principal component analysis in high dimensions.

• 1 publication
• 11 publications
11/07/2018

### A note on the prediction error of principal component regression

We analyse the prediction error of principal component regression (PCR) ...
06/26/2019

### Principal Component Analysis for Multivariate Extremes

The first order behavior of multivariate heavy-tailed random vectors abo...
04/18/2021

### "Average" Approximates "First Principal Component"? An Empirical Analysis on Representations from Neural Language Models

Contextualized representations based on neural language models have furt...
10/15/2019

### Principal Component Projection and Regression in Nearly Linear Time through Asymmetric SVRG

Given a data matrix A∈R^n × d, principal component projection (PCP) and ...
03/07/2018

### Sketching for Principal Component Regression

Principal component regression (PCR) is a useful method for regularizing...
10/03/2022

### Hip Fracture Prediction using the First Principal Component Derived from FEA-Computed Fracture Loads

Hip fracture risk assessment is an important but challenging task. Quant...
10/09/2019

### GeoSES – um Índice Socioeconômico para Estudos de Saúde no Brasil

Objective: to define an index that summarizes the main dimensions of the...