Regularization-free estimation in trace regression with symmetric positive semidefinite matrices

04/23/2015
by   Martin Slawski, et al.
0

Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based approaches promoting low-rankedness, notably nuclear norm regularization, have enjoyed great popularity. In the present paper, we argue that such regularization may no longer be necessary if the underlying matrix is symmetric positive semidefinite (spd) and the design satisfies certain conditions. In this situation, simple least squares estimation subject to an spd constraint may perform as well as regularization-based approaches with a proper choice of the regularization parameter, which entails knowledge of the noise level and/or tuning. By contrast, constrained least squares estimation comes without any tuning parameter and may hence be preferred due to its simplicity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/12/2020

Outlier-robust sparse/low-rank least-squares regression and robust matrix completion

We consider high-dimensional least-squares regression when a fraction ϵ ...
research
07/02/2020

Partial Trace Regression and Low-Rank Kraus Decomposition

The trace regression model, a direct extension of the well-studied linea...
research
04/18/2019

On Low-rank Trace Regression under General Sampling Distribution

A growing number of modern statistical learning problems involve estimat...
research
09/15/2020

Interpolating the Trace of the Inverse of Matrix 𝐀 + t 𝐁

We develop heuristic interpolation methods for the function t ↦trace( (𝐀...
research
05/28/2021

Implicit Regularization in Matrix Sensing via Mirror Descent

We study discrete-time mirror descent applied to the unregularized empir...
research
12/06/2012

Excess risk bounds for multitask learning with trace norm regularization

Trace norm regularization is a popular method of multitask learning. We ...
research
05/04/2021

Nonparametric Trace Regression in High Dimensions via Sign Series Representation

Learning of matrix-valued data has recently surged in a range of scienti...

Please sign up or login with your details

Forgot password? Click here to reset