FATSO: A family of operators for variable selection in linear models

04/11/2019
by   Nicolás E. Kuschinski, et al.
0

In linear models it is common to have situations where several regression coefficients are zero. In these situations a common tool to perform regression is a variable selection operator. One of the most common such operators is the LASSO operator, which promotes point estimates which are zero. The LASSO operator and similar approaches, however, give little in terms of easily interpretable parameters to determine the degree of variable selectivity. In this paper we propose a new family of selection operators which builds on the geometry of LASSO but which yield an easily interpretable way to tune selectivity. These operators correspond to Bayesian prior densities and hence are suitable for Bayesian inference. We present some examples using simulated and real data, with promising results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2021

LocalGLMnet: interpretable deep learning for tabular data

Deep learning models have gained great popularity in statistical modelin...
research
05/07/2023

Provable Identifiability of Two-Layer ReLU Neural Networks via LASSO Regularization

LASSO regularization is a popular regression tool to enhance the predict...
research
10/27/2022

Exhuming nonnegative garrote from oblivion using suitable initial estimates- illustration in low and high-dimensional real data

The nonnegative garrote (NNG) is among the first approaches that combine...
research
03/28/2022

A Comparison of Hamming Errors of Representative Variable Selection Methods

Lasso is a celebrated method for variable selection in linear models, bu...
research
02/24/2021

Sparse online variational Bayesian regression

This work considers variational Bayesian inference as an inexpensive and...
research
04/20/2021

Bayesian subset selection and variable importance for interpretable prediction and classification

Subset selection is a valuable tool for interpretable learning, scientif...
research
06/10/2022

Empirical Likelihood Based Bayesian Variable Selection

Empirical likelihood is a popular nonparametric statistical tool that do...

Please sign up or login with your details

Forgot password? Click here to reset