Adaptive Bayesian nonparametric regression using kernel mixture of polynomials with application to partial linear model

10/22/2017
by   Fangzheng Xie, et al.
0

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local average of polynomials with kernel weights. We obtain the minimax-optimal rate of contraction up to a logarithmic factor that adapts to the smoothness level of the true function by estimating metric entropies of certain function classes. We also provide a frequentist sieve maximum likelihood estimator with a near-optimal convergence rate. We further investigate the application of the kernel mixture of polynomials to the partial linear model and obtain both the near-optimal rate of contraction for the nonparametric component and the Bernstein von-Mises limit (i.e., asymptotic normality) of the parametric component. These results are based on the development of convergence theory for the kernel mixture of polynomials. The proposed method is illustrated with numerical examples and shows superior performance in terms of accuracy and uncertainty quantification compared to the local polynomial regression, DiceKriging, and the robust Gaussian stochastic process.

READ FULL TEXT
research
02/24/2020

Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density

This study examines the optimal selections of bandwidth and semi-metric ...
research
12/15/2017

A Theoretical Framework for Bayesian Nonparametric Regression: Orthonormal Random Series and Rates of Contraction

We develop a unifying framework for Bayesian nonparametric regression to...
research
11/27/2020

Equivalence of Convergence Rates of Posterior Distributions and Bayes Estimators for Functions and Nonparametric Functionals

We study the posterior contraction rates of a Bayesian method with Gauss...
research
06/08/2023

Bayesian Inference for k-Monotone Densities with Applications to Multiple Testing

Shape restriction, like monotonicity or convexity, imposed on a function...
research
08/09/2023

Heavy-tailed Bayesian nonparametric adaptation

We propose a new Bayesian strategy for adaptation to smoothness in nonpa...
research
02/15/2018

Nonparametric Bayesian posterior contraction rates for scalar diffusions with high-frequency data

We consider inference in the scalar diffusion model dX_t=b(X_t)dt+σ(X_t)...
research
05/26/2018

Robust Nonparametric Regression under Huber's ε-contamination Model

We consider the non-parametric regression problem under Huber's ϵ-contam...

Please sign up or login with your details

Forgot password? Click here to reset