Tractable Evaluation of Stein's Unbiased Risk Estimator with Convex Regularizers

11/11/2022
by   Parth Nobel, et al.
0

Stein's unbiased risk estimate (SURE) gives an unbiased estimate of the ℓ_2 risk of any estimator of the mean of a Gaussian random vector. We focus here on the case when the estimator minimizes a quadratic loss term plus a convex regularizer. For these estimators SURE can be evaluated analytically for a few special cases, and generically using recently developed general purpose methods for differentiating through convex optimization problems; these generic methods however do not scale to large problems. In this paper we describe methods for evaluating SURE that handle a wide class of estimators, and also scale to large problem sizes.

READ FULL TEXT

page 27

page 28

page 29

research
09/17/2021

Unbiased Bregman-Risk Estimators: Application to Regularization Parameter Selection in Tomographic Image Reconstruction

Unbiased estimators are introduced for averaged Bregman divergences whic...
research
06/07/2023

Non-minimaxity of debiased shrinkage estimators

We consider the estimation of the p-variate normal mean of X∼ N_p(θ,I) u...
research
04/08/2020

Incidence weighting estimation under bipartite incidence graph sampling

Bipartite incidence graph sampling provides a unified representation of ...
research
01/31/2018

On the construction of unbiased estimators for the group testing problem

Debiased estimation has long been an area of research in the group testi...
research
03/05/2020

Convex Optimization Over Risk-Neutral Probabilities

We consider a collection of derivatives that depend on the price of an u...
research
07/28/2017

Empirical Bayes Estimators for High-Dimensional Sparse Vectors

The problem of estimating a high-dimensional sparse vector θ∈R^n from an...
research
08/12/2019

Sharp Guarantees for Solving Random Equations with One-Bit Information

We study the performance of a wide class of convex optimization-based es...

Please sign up or login with your details

Forgot password? Click here to reset