Statistical Optimality of Divide and Conquer Kernel-based Functional Linear Regression

11/20/2022
by   Jiading Liu, et al.
0

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of divide-and-conquer estimators in the scenario that the target function does not necessarily reside in the underlying RKHS. As a decomposition-based scalable approach, the divide-and-conquer estimators of functional linear regression can substantially reduce the algorithmic complexities in time and memory. We develop an integral operator approach to establish sharp finite sample upper bounds for prediction with divide-and-conquer estimators under various regularity conditions of explanatory variables and target function. We also prove the asymptotic optimality of the derived rates by building the mini-max lower bounds. Finally, we consider the convergence of noiseless estimators and show that the rates can be arbitrarily fast under mild conditions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2017

Robust Regression via Mutivariate Regression Depth

This paper studies robust regression in the settings of Huber's ϵ-contam...
research
07/08/2016

Convergence rates of Kernel Conjugate Gradient for random design regression

We prove statistical rates of convergence for kernel-based least squares...
research
06/03/2018

Analysis of regularized Nyström subsampling for regression functions of low smoothness

This paper studies a Nyström type subsampling approach to large kernel l...
research
02/16/2022

An RKHS approach for pivotal inference in functional linear regression

We develop methodology for testing hypotheses regarding the slope functi...
research
09/29/2010

Optimal learning rates for Kernel Conjugate Gradient regression

We prove rates of convergence in the statistical sense for kernel-based ...
research
08/16/2021

Statistical inference for the slope parameter in functional linear regression

In this paper we consider the linear regression model Y =S X+ε with func...
research
06/30/2018

Robust functional regression based on principal components

Functional data analysis is a fast evolving branch of modern statistics ...

Please sign up or login with your details

Forgot password? Click here to reset