Sparse additive Gaussian process with soft interactions

07/09/2016
by   Garret Vo, et al.
0

Additive nonparametric regression models provide an attractive tool for variable selection in high dimensions when the relationship between the response and predictors is complex. They offer greater flexibility compared to parametric non-linear regression models and better interpretability and scalability than the non-parametric regression models. However, achieving sparsity simultaneously in the number of nonparametric components as well as in the variables within each nonparametric component poses a stiff computational challenge. In this article, we develop a novel Bayesian additive regression model using a combination of hard and soft shrinkages to separately control the number of additive components and the variables within each component. An efficient algorithm is developed to select the importance variables and estimate the interaction network. Excellent performance is obtained in simulated and real data examples.

READ FULL TEXT

page 14

page 16

page 17

page 24

page 27

research
07/03/2021

Novel Semi-parametric Tobit Additive Regression Models

Regression method has been widely used to explore relationship between d...
research
07/18/2019

Bayesian Variable Selection for Gaussian copula regression models

We develop a novel Bayesian method to select important predictors in reg...
research
02/26/2023

Independence-Encouraging Subsampling for Nonparametric Additive Models

The additive model is a popular nonparametric regression method due to i...
research
06/28/2018

Additivity Assessment in Nonparametric Models Using Ratio of Pseudo Marginal Likelihoods

Nonparametric regression models such as Bayesian Additive Regression Tre...
research
12/18/2020

Flexible, Non-parametric Modeling Using Regularized Neural Networks

Non-parametric regression, such as generalized additive models (GAMs), i...
research
03/05/2023

On Bayesian Generalized Additive Models

Generalized additive models (GAMs) provide a way to blend parametric and...
research
04/06/2018

Least Squares Wavelet-based Estimation for Additive Regression Models using Non Equally-Spaced Designs

Additive regression models are actively researched in the statistical fi...

Please sign up or login with your details

Forgot password? Click here to reset