Sparse Laplacian Shrinkage with the Graphical Lasso Estimator for Regression Problems

04/09/2019
by   Yuehan Yang, et al.
0

This paper considers a high-dimensional linear regression problem where there are complex correlation structures among predictors. We propose a graph-constrained regularization procedure, named Sparse Laplacian Shrinkage with the Graphical Lasso Estimator (SLS-GLE). The procedure uses the estimated precision matrix to describe the specific information on the conditional dependence pattern among predictors, and encourages both sparsity on the regression model and the graphical model. We introduce the Laplacian quadratic penalty adopting the graph information, and give detailed discussions on the advantages of using the precision matrix to construct the Laplacian matrix. Theoretical properties and numerical comparisons are presented to show that the proposed method improves both model interpretability and accuracy of estimation. We also apply this method to a financial problem and prove that the proposed procedure is successful in assets selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/31/2021

Laplacian Constrained Precision Matrix Estimation: Existence and High Dimensional Consistency

This paper considers the problem of estimating high dimensional Laplacia...
research
11/16/2021

Sparse Graph Learning Under Laplacian-Related Constraints

We consider the problem of learning a sparse undirected graph underlying...
research
01/16/2019

Smooth Adjustment for Correlated Effects

This paper considers a high dimensional linear regression model with cor...
research
09/17/2021

Learning Sparse Graph with Minimax Concave Penalty under Gaussian Markov Random Fields

This paper presents a convex-analytic framework to learn sparse graphs f...
research
07/17/2014

Sparse Quadratic Discriminant Analysis and Community Bayes

We develop a class of rules spanning the range between quadratic discrim...
research
02/13/2023

Efficient Graph Laplacian Estimation by a Proximal Newton Approach

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a comm...
research
03/23/2011

Theoretical Properties of the Overlapping Groups Lasso

We present two sets of theoretical results on the grouped lasso with ove...

Please sign up or login with your details

Forgot password? Click here to reset