Tuning-free ridge estimators for high-dimensional generalized linear models

02/27/2020
by   Shih-Ting Huang, et al.
0

Ridge estimators regularize the squared Euclidean lengths of parameters. Such estimators are mathematically and computationally attractive but involve tuning parameters that can be difficult to calibrate. In this paper, we show that ridge estimators can be modified such that tuning parameters can be avoided altogether. We also show that these modified versions can improve on the empirical prediction accuracies of standard ridge estimators combined with cross-validation, and we provide first theoretical guarantees.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2019

Ridge-type Linear Shrinkage Estimation of the Matrix Mean of High-dimensional Normal Distribution

The estimation of the mean matrix of the multivariate normal distributio...
research
02/07/2019

Estimation of variance components, heritability and the ridge penalty in high-dimensional generalized linear models

For high-dimensional linear regression models, we review and compare sev...
research
09/01/2020

Time-Varying Parameters as Ridge Regressions

Time-varying parameters (TVPs) models are frequently used in economics t...
research
05/28/2020

Ridge TRACE Diagnostics

We describe a new p-parameter generalized ridge-regression shrinkage-pat...
research
04/26/2021

Algorithms for ridge estimation with convergence guarantees

The extraction of filamentary structure from a point cloud is discussed....
research
02/04/2016

Risk estimation for high-dimensional lasso regression

In high-dimensional estimation, analysts are faced with more parameters ...
research
06/07/2015

Optimal Ridge Detection using Coverage Risk

We introduce the concept of coverage risk as an error measure for densit...

Please sign up or login with your details

Forgot password? Click here to reset