Gibbs posterior for variable selection in high-dimensional classification and data mining

10/31/2008
by   Wenxin Jiang, et al.
0

In the popular approach of "Bayesian variable selection" (BVS), one uses prior and posterior distributions to select a subset of candidate variables to enter the model. A completely new direction will be considered here to study BVS with a Gibbs posterior originating in statistical mechanics. The Gibbs posterior is constructed from a risk function of practical interest (such as the classification error) and aims at minimizing a risk function without modeling the data probabilistically. This can improve the performance over the usual Bayesian approach, which depends on a probability model which may be misspecified. Conditions will be provided to achieve good risk performance, even in the presence of high dimensionality, when the number of candidate variables "K" can be much larger than the sample size "n." In addition, we develop a convenient Markov chain Monte Carlo algorithm to implement BVS with the Gibbs posterior.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2015

On the Computational Complexity of High-Dimensional Bayesian Variable Selection

We study the computational complexity of Markov chain Monte Carlo (MCMC)...
research
07/03/2023

Bayesian variable selection using an informed reversible jump in imaging genetics: an application to schizophrenia

Modern attempts in providing predictive risk for complex disorders, such...
research
12/03/2020

A Note on Bayesian Modeling Specification of Censored Data in JAGS

Just Another Gibbs Sampling (JAGS) is a convenient tool to draw posterio...
research
06/12/2015

On the properties of variational approximations of Gibbs posteriors

The PAC-Bayesian approach is a powerful set of techniques to derive non-...
research
02/10/2021

Bayesian Knockoff Filter Using Gibbs Sampler

In many fields, researchers are interested in discovering features with ...
research
12/03/2007

Pac-Bayesian Supervised Classification: The Thermodynamics of Statistical Learning

This monograph deals with adaptive supervised classification, using tool...
research
04/14/2023

Complexity of Gibbs samplers through Bayesian asymptotics

Gibbs samplers are popular algorithms to approximate posterior distribut...

Please sign up or login with your details

Forgot password? Click here to reset