A Permutation Approach for Selecting the Penalty Parameter in Penalized Model Selection

04/08/2014
by   Jeremy Sabourin, et al.
0

We describe a simple, efficient, permutation based procedure for selecting the penalty parameter in the LASSO. The procedure, which is intended for applications where variable selection is the primary focus, can be applied in a variety of structural settings, including generalized linear models. We briefly discuss connections between permutation selection and existing theory for the LASSO. In addition, we present a simulation study and an analysis of three real data sets in which permutation selection is compared with cross-validation (CV), the Bayesian information criterion (BIC), and a selection method based on recently developed testing procedures for the LASSO.

READ FULL TEXT

page 16

page 17

research
10/06/2021

Variable Selection Using a Smooth Information Criterion for Multi-Parameter Regression Models

Modern variable selection procedures make use of penalization methods to...
research
06/14/2023

The generalized hyperbolic family and automatic model selection through the multiple-choice LASSO

We revisit the generalized hyperbolic (GH) distribution and its nested m...
research
01/06/2022

Predictive Criteria for Prior Selection Using Shrinkage in Linear Models

Choosing a shrinkage method can be done by selecting a penalty from a li...
research
07/31/2013

Fast Simultaneous Training of Generalized Linear Models (FaSTGLZ)

We present an efficient algorithm for simultaneously training sparse gen...
research
11/10/2019

A constrained minimum criterion for variable selection

For variable selection in the sparse linear model setting, we propose a ...
research
06/04/2018

Post model-fitting exploration via a "Next-Door" analysis

We propose a simple method for evaluating the model that has been chosen...
research
07/26/2022

An exhaustive variable selection study for linear models of soundscape emotions: rankings and Gibbs analysis

In the last decade, soundscapes have become one of the most active topic...

Please sign up or login with your details

Forgot password? Click here to reset