An Efficient Augmented Lagrangian Based Method for Constrained Lasso

03/12/2019
by   Zengde Deng, et al.
0

Variable selection is one of the most important tasks in statistics and machine learning. To incorporate more prior information about the regression coefficients, the constrained Lasso model has been proposed in the literature. In this paper, we present an inexact augmented Lagrangian method to solve the Lasso problem with linear equality constraints. By fully exploiting second-order sparsity of the problem, we are able to greatly reduce the computational cost and obtain highly efficient implementations. Furthermore, numerical results on both synthetic data and real data show that our algorithm is superior to existing first-order methods in terms of both running time and solution accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2021

A dual semismooth Newton based augmented Lagrangian method for large-scale linearly constrained sparse group square-root Lasso problems

Square-root Lasso problems are proven robust regression problems. Furthe...
research
06/06/2020

An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

Feature selection is an important and active research area in statistics...
research
10/28/2016

Algorithms for Fitting the Constrained Lasso

We compare alternative computing strategies for solving the constrained ...
research
08/22/2018

Efficient sparse Hessian based algorithms for the clustered lasso problem

We focus on solving the clustered lasso problem, which is a least square...
research
07/17/2022

The Variable Projected Augmented Lagrangian Method

Inference by means of mathematical modeling from a collection of observa...
research
12/11/2018

Variational Bayesian Complex Network Reconstruction

Complex network reconstruction is a hot topic in many fields. A popular ...
research
07/01/2022

The augmented Lagrangian method as a framework for stabilised methods in computational mechanics

In this paper we will review recent advances in the application of the a...

Please sign up or login with your details

Forgot password? Click here to reset