Adaptive Function-on-Scalar Regression with a Smoothing Elastic Net

05/23/2019
by   Ardalan Mirshani, et al.
0

This paper presents a new methodology, called AFSSEN, to simultaneously select significant predictors and produce smooth estimates in a high-dimensional function-on-scalar linear model with a sub-Gaussian errors. Outcomes are assumed to lie in a general real separable Hilbert space, H, while parameters lie in a subspace known as a Cameron Martin space, K, which are closely related to Reproducing Kernel Hilbert Spaces, so that parameter estimates inherit particular properties, such as smoothness or periodicity, without enforcing such properties on the data. We propose a regularization method in the style of an adaptive Elastic Net penalty that involves mixing two types of functional norms, providing a fine tune control of both the smoothing and variable selection in the estimated model. Asymptotic theory is provided in the form of a functional oracle property, and the paper concludes with a simulation study demonstrating the advantage of using AFSSEN over existing methods in terms of prediction error and variable selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/14/2021

Variable Selection and Regularization via Arbitrary Rectangle-range Generalized Elastic Net

We introduce the arbitrary rectangle-range generalized elastic net penal...
research
05/16/2018

Structured nonlinear variable selection

We investigate structured sparsity methods for variable selection in reg...
research
07/05/2021

Multivariate functional group sparse regression: functional predictor selection

In this paper, we propose methods for functional predictor selection and...
research
09/29/2021

A gradient-based variable selection for binary classification in reproducing kernel Hilbert space

Variable selection is essential in high-dimensional data analysis. Altho...
research
06/25/2019

Simultaneous Variable Selection, Clustering, and Smoothing in Function on Scalar Regression

We address the problem of multicollinearity in a function-on-scalar regr...
research
12/04/2020

Latent function-on-scalar regression models for observed sequences of binary data: a restricted likelihood approach

In this paper, we study a functional regression setting where the random...
research
04/20/2018

Generalized Linear Model for Gamma Distributed Variables via Elastic Net Regularization

The Generalized Linear Model (GLM) for the Gamma distribution (glmGamma)...

Please sign up or login with your details

Forgot password? Click here to reset