Variational Full Bayes Lasso: Knots Selection in Regression Splines

02/26/2021
by   Larissa Alves, et al.
0

We develop a fully automatic Bayesian Lasso via variational inference. This is a scalable procedure for approximating the posterior distribution. Special attention is driven to the knot selection in regression spline. In order to carry through our proposal, a full automatic variational Bayesian Lasso, a Jefferey's prior is proposed for the hyperparameters and a decision theoretical approach is introduced to decide if a knot is selected or not. Extensive simulation studies were developed to ensure the effectiveness of the proposed algorithms. The performance of the algorithms were also tested in some real data sets, including data from the world pandemic Covid-19. Again, the algorithms showed a very good performance in capturing the data structure.

READ FULL TEXT

page 23

page 25

page 26

page 29

page 30

research
04/01/2022

Approximate Gibbs sampler for Bayesian Huberized lasso

The Bayesian lasso is well-known as a Bayesian alternative for lasso. Al...
research
01/20/2022

Bayesian Fused Lasso Modeling via Horseshoe Prior

Bayesian fused lasso is one of the sparse Bayesian methods, which shrink...
research
06/19/2022

Bayesian non-conjugate regression via variational belief updating

We present an efficient semiparametric variational method to approximate...
research
07/11/2023

CR-Lasso: Robust cellwise regularized sparse regression

Cellwise contamination remains a challenging problem for data scientists...
research
06/28/2022

Bayesian Multi-task Variable Selection with an Application to Differential DAG Analysis

In this paper, we study the Bayesian multi-task variable selection probl...
research
12/11/2018

Variational Bayesian Complex Network Reconstruction

Complex network reconstruction is a hot topic in many fields. A popular ...
research
02/22/2018

Bayesian Lasso : Concentration and MCMC Diagnosis

Using posterior distribution of Bayesian LASSO we construct a semi-norm ...

Please sign up or login with your details

Forgot password? Click here to reset