Computing the degrees of freedom of rank-regularized estimators and cousins

09/23/2019
by   Rahul Mazumder, et al.
0

Estimating a low rank matrix from its linear measurements is a problem of central importance in contemporary statistical analysis. The choice of tuning parameters for estimators remains an important challenge from a theoretical and practical perspective. To this end, Stein's Unbiased Risk Estimate (SURE) framework provides a well-grounded statistical framework for degrees of freedom estimation. In this paper, we use the SURE framework to obtain degrees of freedom estimates for a general class of spectral regularized matrix estimators, generalizing beyond the class of estimators that have been studied thus far. To this end, we use a result due to Shapiro (2002) pertaining to the differentiability of symmetric matrix valued functions, developed in the context of semidefinite optimization algorithms. We rigorously verify the applicability of Stein's lemma towards the derivation of degrees of freedom estimates; and also present new techniques based on Gaussian convolution to estimate the degrees of freedom of a class of spectral estimators to which Stein's lemma is not directly applicable.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2018

Degrees of Freedom and Model Selection for kmeans Clustering

This paper investigates the problem of model selection for kmeans cluste...
research
12/29/2021

A comment and erratum on "Excess Optimism: How Biased is the Apparent Error of an Estimator Tuned by SURE?"

We identify and correct an error in the paper "Excess Optimism: How Bias...
research
11/07/2022

Exponential Hilbert series and hierarchical log-linear models

Consider a hierarchical log-linear model, given by a simplicial complex,...
research
01/18/2021

The Violating Assumptions Series: Simulated demonstrations to illustrate how assumptions can affect statistical estimates

When teaching and discussing statistical assumptions, our focus is often...
research
02/25/2022

Connecting Gaits in Energetically Conservative Legged Systems

In this work, we present a nonlinear dynamics perspective on generating ...
research
09/14/2023

Spectrum-Aware Adjustment: A New Debiasing Framework with Applications to Principal Components Regression

We introduce a new debiasing framework for high-dimensional linear regre...
research
05/13/2020

Recognition of 26 Degrees of Freedom of Hands Using Model-based approach and Depth-Color Images

In this study, we present an model-based approach to recognize full 26 d...

Please sign up or login with your details

Forgot password? Click here to reset