On Semi-parametric Bernstein-von Mises Theorems for BART

05/09/2019
by   Veronika Rockova, et al.
0

Few methods in Bayesian non-parametric statistics/ machine learning have received as much attention as Bayesian Additive Regression Trees (BART). While BART is now routinely performed for prediction tasks, its theoretical properties began to be understood only very recently. In this work, we continue the theoretical investigation of BART initiated by Rockova and van der Pas (2017). In particular, we study the Bernstein-von Mises (BvM) phenomenon (i.e. asymptotic normality) for smooth linear functionals of the regression surface within the framework of non-parametric regression with fixed covariates. As with other adaptive priors, the BvM phenomenon may fail when the regularities of the functional and the truth are not compatible. To overcome the curse of adaptivity under hierarchical priors, we induce a self-similarity assumption to ensure convergence towards a single Gaussian distribution as opposed to a Gaussian mixture. Similar qualitative restrictions on the functional parameter are known to be necessary for adaptive inference. Many machine learning methods lack coherent probabilistic mechanisms for gauging uncertainty. BART readily provides such quantification via posterior credible sets. The BvM theorem implies that the credible sets are also confidence regions with the same asymptotic coverage. This paper presents the first asymptotic normality result for BART priors, providing another piece of evidence that BART is a valid tool from a frequentist point of view.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/26/2020

Uncertainty Quantification for Sparse Deep Learning

Deep learning methods continue to have a decided impact on machine learn...
research
05/23/2019

A Bulirsch-Stoer algorithm using Gaussian processes

In this paper, we treat the problem of evaluating the asymptotic error i...
research
05/26/2021

Ideal Bayesian Spatial Adaptation

Many real-life applications involve estimation of curves that exhibit co...
research
10/16/2019

Multiscale Analysis of Bayesian CART

This paper affords new insights about Bayesian CART in the context of st...
research
04/09/2018

A Bayes-Sard Cubature Method

This paper focusses on the formulation of numerical integration as an in...
research
09/11/2018

Nonparametric Bayesian analysis of the compound Poisson prior for support boundary recovery

Given data from a Poisson point process with intensity (x,y) n 1(f(x)≤ ...
research
12/14/2019

Monotone function estimation in the presence of extreme data coarsening: Analysis of preeclampsia and birth weight in urban Uganda

This paper proposes a Bayesian hierarchical model to characterize the re...

Please sign up or login with your details

Forgot password? Click here to reset