Learning Heteroscedastic Models by Convex Programming under Group Sparsity

04/16/2013
by   Arnak S. Dalalyan, et al.
0

Popular sparse estimation methods based on ℓ_1-relaxation, such as the Lasso and the Dantzig selector, require the knowledge of the variance of the noise in order to properly tune the regularization parameter. This constitutes a major obstacle in applying these methods in several frameworks---such as time series, random fields, inverse problems---for which the noise is rarely homoscedastic and its level is hard to know in advance. In this paper, we propose a new approach to the joint estimation of the conditional mean and the conditional variance in a high-dimensional (auto-) regression setting. An attractive feature of the proposed estimator is that it is efficiently computable even for very large scale problems by solving a second-order cone program (SOCP). We present theoretical analysis and numerical results assessing the performance of the proposed procedure.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2020

A Gradient-thresholding Algorithm for Sparse Regularization

Inverse problems arise in a wide spectrum of applications in fields rang...
research
12/06/2017

Estimating the error variance in a high-dimensional linear model

The lasso has been studied extensively as a tool for estimating the coef...
research
11/09/2018

Second order Stein: SURE for SURE and other applications in high-dimensional inference

Stein's formula states that a random variable of the form z^ f(z) - div ...
research
01/02/2011

Sparse recovery with unknown variance: a LASSO-type approach

We address the issue of estimating the regression vector β in the generi...
research
07/15/2019

Tensor train-Karhunen-Loève expansion for continuous-indexed random fields using higher-order cumulant functions

The goals of this work are two-fold: firstly, to propose a new theoretic...
research
02/07/2019

Concomitant Lasso with Repetitions (CLaR): beyond averaging multiple realizations of heteroscedastic noise

Sparsity promoting norms are frequently used in high dimensional regress...
research
04/27/2016

Local Uncertainty Sampling for Large-Scale Multi-Class Logistic Regression

A major challenge for building statistical models in the big data era is...

Please sign up or login with your details

Forgot password? Click here to reset