Bayesian bandwidth estimation for local linear fitting in nonparametric regression models

11/09/2020
by   Han Lin Shang, et al.
0

This paper presents a Bayesian sampling approach to bandwidth estimation for the local linear estimator of the regression function in a nonparametric regression model. In the Bayesian sampling approach, the error density is approximated by a location-mixture density of Gaussian densities with means the individual errors and variance a constant parameter. This mixture density has the form of a kernel density estimator of errors and is referred to as the kernel-form error density (c.f., Zhang et al., 2014). While Zhang et al. (2014) use the local constant (also known as the Nadaraya- Watson) estimator to estimate the regression function, we extend this to the local linear estimator, which produces more accurate estimation. The proposed investigation is motivated by the lack of data-driven methods for simultaneously choosing bandwidths in the local linear estimator of the regression function and kernel-form error density. Treating bandwidths as parameters, we derive an approximate (pseudo) likelihood and a posterior. A simulation study shows that the proposed bandwidth estimation outperforms the rule-of-thumb and cross-validation methods under the criterion of integrated squared errors. The proposed bandwidth estimation method is validated through a nonparametric regression model involving firm ownership concentration, and a model involving state-price density estimation.

READ FULL TEXT

page 12

page 13

page 14

10/03/2018

Estimating the error distribution function in nonparametric regression

We construct an efficient estimator for the error distribution function ...
06/13/2020

Kernel Selection in Nonparametric Regression

In the regression model Y = b(X) +ε, where X has a density f, this paper...
05/25/2021

Optimal Sampling Density for Nonparametric Regression

We propose a novel active learning strategy for regression, which is mod...
02/27/2019

Local Bandwidth Estimation via Mixture of Gaussian Processes

Real world data often exhibit inhomogeneity - complexity of the target f...
10/19/2018

Estimation of a functional single index model with dependent errors and unknown error density

The problem of error density estimation for a functional single index mo...
06/22/2019

Density Estimation on a Network

This paper develops a novel approach to density estimation on a network....
10/16/2018

Density Deconvolution with Small Berkson Errors

The present paper studies density deconvolution in the presence of small...