Asymptotic Theory of Bayes Factor for Nonparametric Model and Variable Selection in the Gaussian Process Framework

10/23/2018
by   Minerva Mukhopadhyay, et al.
0

In this paper we consider the Bayes factor approach to general model and variable selection under a nonparametric, Gaussian process framework. Specifically, we establish that under reasonable conditions, the Bayes factor consistently selects the correct model with exponentially fast convergence rate. If the true model does not belong to the postulated model space, then the Bayes factor asymptotically selects the best possible model in the model space with exponentially fast convergence rate. We derive several theoretical applications of the proposed method to various setups like the simple linear regression, reproducing kernel Hilbert space (RKHS) models, autoregressive (AR) models, and combinations of such models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2011

Dimension adaptability of Gaussian process models with variable selection and projection

It is now known that an extended Gaussian process model equipped with re...
research
12/12/2019

Variable Selection Consistency of Gaussian Process Regression

Bayesian nonparametric regression under a rescaled Gaussian process prio...
research
09/15/2021

Bayesian testing of linear versus nonlinear effects using Gaussian process priors

A Bayes factor is proposed for testing whether the effect of a key predi...
research
06/10/2020

Convergence of Pseudo-Bayes Factors in Forward and Inverse Regression Problems

In the Bayesian literature on model comparison, Bayes factors play the l...
research
06/01/2019

Kernel Instrumental Variable Regression

Instrumental variable regression is a strategy for learning causal relat...
research
12/30/2021

Variable selection, monotone likelihood ratio and group sparsity

In the pivotal variable selection problem, we derive the exact non-asymp...
research
08/13/2012

Nonparametric sparsity and regularization

In this work we are interested in the problems of supervised learning an...

Please sign up or login with your details

Forgot password? Click here to reset