Functional Linear Regression with Mixed Predictors

12/01/2020
by   Daren Wang, et al.
0

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression models in the literature as special cases. Based on the theory of reproducing kernel Hilbert spaces (RKHS), we propose a penalized least squares estimator that can accommodate functional variables observed on discrete grids. Besides the conventional smoothness penalties, a group Lasso-type penalty is further imposed to induce sparsity in the high-dimensional vector predictors. We derive finite sample theoretical guarantees and show that the excess prediction risk of our estimator is minimax optimal. Furthermore, our analysis reveals an interesting phase transition phenomenon that the optimal excess risk is determined jointly by the smoothness and the sparsity of the functional regression coefficients. A novel efficient optimization algorithm based on iterative coordinate descent is devised to handle the smoothness and sparsity penalties simultaneously. Simulation studies and real data applications illustrate the promising performance of the proposed approach compared to the state-of-the-art methods in the literature.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

05/26/2019

Nonregular and Minimax Estimation of Individualized Thresholds in High Dimension with Binary Responses

Given a large number of covariates Z, we consider the estimation of a hi...
06/08/2022

Unified RKHS Methodology and Analysis for Functional Linear and Single-Index Models

Functional linear and single-index models are core regression methods in...
02/10/2019

Optimal Penalized Function-on-Function Regression under a Reproducing Kernel Hilbert Space Framework

Many scientific studies collect data where the response and predictor va...
06/25/2008

High-dimensional additive modeling

We propose a new sparsity-smoothness penalty for high-dimensional genera...
06/15/2020

Linear functional regression with truncated signatures

We place ourselves in a functional regression setting and propose a nove...
01/18/2017

Surrogate Aided Unsupervised Recovery of Sparse Signals in Single Index Models for Binary Outcomes

We consider the recovery of regression coefficients, denoted by β_0, for...
06/03/2020

Structure Adaptive Lasso

Lasso is of fundamental importance in high-dimensional statistics and ha...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.