DeepAI
Log In Sign Up

Tuning-free ridge estimators for high-dimensional generalized linear models

02/27/2020
by   Shih-Ting Huang, et al.
0

Ridge estimators regularize the squared Euclidean lengths of parameters. Such estimators are mathematically and computationally attractive but involve tuning parameters that can be difficult to calibrate. In this paper, we show that ridge estimators can be modified such that tuning parameters can be avoided altogether. We also show that these modified versions can improve on the empirical prediction accuracies of standard ridge estimators combined with cross-validation, and we provide first theoretical guarantees.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/26/2019

Ridge-type Linear Shrinkage Estimation of the Matrix Mean of High-dimensional Normal Distribution

The estimation of the mean matrix of the multivariate normal distributio...
09/01/2020

Time-Varying Parameters as Ridge Regressions

Time-varying parameters (TVPs) models are frequently used in economics t...
05/28/2020

Ridge TRACE Diagnostics

We describe a new p-parameter generalized ridge-regression shrinkage-pat...
06/07/2015

Optimal Ridge Detection using Coverage Risk

We introduce the concept of coverage risk as an error measure for densit...
04/26/2021

Algorithms for ridge estimation with convergence guarantees

The extraction of filamentary structure from a point cloud is discussed....
02/04/2016

Risk estimation for high-dimensional lasso regression

In high-dimensional estimation, analysts are faced with more parameters ...