FKreg: A MATLAB toolbox for fast Multivariate Kernel Regression

04/16/2022
by   Ying Wang, et al.
5

Kernel smooth is the most fundamental technique for data density and regression estimation. However, time-consuming is the biggest obstacle for the application that the direct evaluation of kernel smooth for N samples needs O( N^2) operations. People have developed fast smooth algorithms using the idea of binning with FFT. Unfortunately, the accuracy is not controllable, and the implementation for multivariable and its bandwidth selection for the fast method is not available. Hence, we introduce a new MATLAB toolbox for fast multivariate kernel regression with the idea of non-uniform FFT (NUFFT), which implemented the algorithm for M gridding points with O( N+Mlog M ) complexity and accuracy controllability. The bandwidth selection problem utilizes the Fast Monte-Carlo algorithm to estimate the degree of freedom (DF), saving enormous cross-validation time even better when data share the same grid space for multiple regression. Up to now, this is the first toolbox for fast-binning high-dimensional kernel regression. Moreover, the estimation for local polynomial regression, the conditional variance for the heteroscedastic model, and the complex-valued datasets are also implemented in this toolbox. The performance is demonstrated with simulations and an application on the quantitive EEG.

READ FULL TEXT
research
12/04/2017

Fast and stable multivariate kernel density estimation by fast sum updating

Kernel density estimation and kernel regression are powerful but computa...
research
05/07/2020

Fast multivariate empirical cumulative distribution function with connection to kernel density estimation

This paper revisits the problem of computing empirical cumulative distri...
research
04/20/2023

Optimal Kernel for Kernel-Based Modal Statistical Methods

Kernel-based modal statistical methods include mode estimation, regressi...
research
05/24/2022

Bandwidth Selection for Gaussian Kernel Ridge Regression via Jacobian Control

Most machine learning methods depend on the tuning of hyper-parameters. ...
research
02/27/2019

Local Bandwidth Estimation via Mixture of Gaussian Processes

Real world data often exhibit inhomogeneity - complexity of the target f...
research
09/12/2022

Locally Weighted Regression with different Kernel Smoothers for Software Effort Estimation

Estimating software effort has been a largely unsolved problem for decad...
research
09/12/2007

Bandwidth selection for kernel estimation in mixed multi-dimensional spaces

Kernel estimation techniques, such as mean shift, suffer from one major ...

Please sign up or login with your details

Forgot password? Click here to reset