Nonparametric regression using needlet kernels for spherical data

02/14/2015
by   Shaobo Lin, et al.
0

Needlets have been recognized as state-of-the-art tools to tackle spherical data, due to their excellent localization properties in both spacial and frequency domains. This paper considers developing kernel methods associated with the needlet kernel for nonparametric regression problems whose predictor variables are defined on a sphere. Due to the localization property in the frequency domain, we prove that the regularization parameter of the kernel ridge regression associated with the needlet kernel can decrease arbitrarily fast. A natural consequence is that the regularization term for the kernel ridge regression is not necessary in the sense of rate optimality. Based on the excellent localization property in the spacial domain further, we also prove that all the l^q (01≤ q < ∞) kernel regularization estimates associated with the needlet kernel, including the kernel lasso estimate and the kernel bridge estimate, possess almost the same generalization capability for a large range of regularization parameters in the sense of rate optimality. This finding tentatively reveals that, if the needlet kernel is utilized, then the choice of q might not have a strong impact in terms of the generalization capability in some modeling contexts. From this perspective, q can be arbitrarily specified, or specified merely by other no generalization criteria like smoothness, computational complexity, sparsity, etc..

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2013

Does generalization performance of l^q regularization learning depend on q? A negative example

l^q-regularization has been demonstrated to be an attractive technique i...
research
12/19/2013

Learning rates of l^q coefficient regularization learning with Gaussian kernel

Regularization is a well recognized powerful strategy to improve the per...
research
01/17/2023

A Distribution Free Truncated Kernel Ridge Regression Estimator and Related Spectral Analyses

It is well known that kernel ridge regression (KRR) is a popular nonpara...
research
06/14/2019

Spectrally-truncated kernel ridge regression and its free lunch

Kernel ridge regression (KRR) is a well-known and popular nonparametric ...
research
05/09/2012

L2 Regularization for Learning Kernels

The choice of the kernel is critical to the success of many learning alg...
research
06/28/2022

Target alignment in truncated kernel ridge regression

Kernel ridge regression (KRR) has recently attracted renewed interest du...
research
07/11/2012

On-line Prediction with Kernels and the Complexity Approximation Principle

The paper describes an application of Aggregating Algorithm to the probl...

Please sign up or login with your details

Forgot password? Click here to reset