Least Angle Regression in Tangent Space and LASSO for Generalized Linear Model

07/18/2019
by   Yoshihiro Hirose, et al.
0

We propose sparse estimation methods for the generalized linear models, which run Least Angle Regression (LARS) and Least Absolute Shrinkage and Selection Operator (LASSO) in the tangent space of the manifold of the statistical model. Our approach is to roughly approximate the statistical model and to subsequently use exact calculations. LARS was proposed as an efficient algorithm for parameter estimation and variable selection for the normal linear model. The LARS algorithm is described in terms of Euclidean geometry with regarding correlation as metric of the space. Since the LARS algorithm only works in Euclidean space, we transform a manifold of the statistical model into the tangent space at the origin. In the generalized linear regression, this transformation allows us to run the original LARS algorithm for the generalized linear models. The proposed methods are efficient and perform well. Real-data analysis shows that the proposed methods output similar results as that of the l_1-penalized maximum likelihood estimation for the generalized linear models. Numerical experiments show that our methods work well and they can be better than the l_1-penalization for the generalized linear models in generalization, parameter estimation, and model selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2017

Variable Selection in Restricted Linear Regression Models

The use of prior information in the linear regression is well known to p...
research
06/29/2022

Parallel square-root statistical linear regression for inference in nonlinear state space models

In this article, we introduce parallel-in-time methods for state and par...
research
11/03/2017

Generalized Linear Model Regression under Distance-to-set Penalties

Estimation in generalized linear models (GLM) is complicated by the pres...
research
09/21/2018

Holonomic extended least angle regression

One of the main problems studied in statistics is the fitting of models....
research
08/25/2020

Regularization Methods Based on the L_q-Likelihood for Linear Models with Heavy-Tailed Errors

We propose regularization methods for linear models based on the L_q-lik...
research
02/08/2013

Efficiency for Regularization Parameter Selection in Penalized Likelihood Estimation of Misspecified Models

It has been shown that AIC-type criteria are asymptotically efficient se...
research
01/21/2021

A General Framework of Online Updating Variable Selection for Generalized Linear Models with Streaming Datasets

In the research field of big data, one of important issues is how to rec...

Please sign up or login with your details

Forgot password? Click here to reset