On a Nadaraya-Watson Estimator with Two Bandwidths

01/26/2020
by   Fabienne Comte, et al.
0

In a regression model, we write the Nadaraya-Watson estimator of the regression function as the quotient of two kernel estimators, and propose a bandwidth selection method for both the numerator and the denominator. We prove risk bounds for both data driven estimators and for the resulting ratio. The simulation study confirms that both estimators have good performances, compared to the ones obtained by cross-validation selection of the bandwidth. However, unexpectedly, the single-bandwidth cross-validation estimator is found to be much better while choosing very small bandwidths. It performs even better than the ratio of the two best estimators of the numerator and the denominator of the collection, for which larger bandwidth are to be chosen.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/10/2021

Bagging cross-validated bandwidth selection in nonparametric regression estimation with applications to large-sized samples

Cross-validation is a well-known and widely used bandwidth selection met...
research
05/24/2022

Bandwidth Selection for Gaussian Kernel Ridge Regression via Jacobian Control

Most machine learning methods depend on the tuning of hyper-parameters. ...
research
09/18/2023

Error Reduction from Stacked Regressions

Stacking regressions is an ensemble technique that forms linear combinat...
research
10/07/2020

A consistent second-order discrete kernel smoother

The histogram estimator of a discrete probability mass function often ex...
research
06/28/2023

Adaptive functional principal components analysis

Functional data analysis (FDA) almost always involves smoothing discrete...
research
03/21/2018

Efficient Bandwidth Estimation in Two-dimensional Filtered Backprojection Reconstruction

A method to efficiently estimate the bandwidth of the reconstruction fil...
research
07/26/2021

Debiasing In-Sample Policy Performance for Small-Data, Large-Scale Optimization

Motivated by the poor performance of cross-validation in settings where ...

Please sign up or login with your details

Forgot password? Click here to reset