Optimal singular value shrinkage with noise homogenization

11/06/2018
by   William Leeb, et al.
0

We derive the optimal singular values for prediction in the spiked model with noise homogenization, which equalizes the noise level across all coordinates. As part of this derivation, we obtain new asymptotic results for the high-dimensional spiked model with heteroskedastic noise, and consistent estimators for the relevant population parameters. We demonstrate the advantages of noise homogenization theoretically and through simulations. Specifically, we prove that in a certain asymptotic regime optimal shrinkage with homogenization converges to the best linear predictor, whereas shrinkage without homogenization converges to a suboptimal linear filter. We show that homogenization increases a natural signal-to-noise ratio of the observations. We also extend previous analysis on out-of-sample prediction to the setting of predictors with homogenization.

READ FULL TEXT
research
05/24/2020

Optimal singular value shrinkage for operator norm loss

We study the denoising of low-rank matrices by singular value shrinkage....
research
07/07/2022

Optimal shrinkage of singular values under high-dimensional noise with separable covariance structure

We consider an optimal shrinkage algorithm that depends on an effective ...
research
12/14/2018

Complex diffusion-weighted image estimation via matrix recovery under general noise models

We propose a patch-based singular value shrinkage method for diffusion m...
research
10/26/2017

Optimal Shrinkage of Singular Values Under Random Data Contamination

A low rank matrix X has been contaminated by uniformly distributed noise...
research
11/02/2022

Matrix Denoising with Partial Noise Statistics: Optimal Singular Value Shrinkage of Spiked F-Matrices

We study the problem of estimating a large, low-rank matrix corrupted by...
research
10/19/2021

Long Random Matrices and Tensor Unfolding

In this paper, we consider the singular values and singular vectors of l...
research
07/22/2019

Doubly robust off-policy evaluation with shrinkage

We design a new family of estimators for off-policy evaluation in contex...

Please sign up or login with your details

Forgot password? Click here to reset