FAStEN: an efficient adaptive method for feature selection and estimation in high-dimensional functional regressions

03/26/2023
by   Tobia Boschi, et al.
0

Functional regression analysis is an established tool for many contemporary scientific applications. Regression problems involving large and complex data sets are ubiquitous, and feature selection is crucial for avoiding overfitting and achieving accurate predictions. We propose a new, flexible, and ultra-efficient approach to perform feature selection in a sparse high dimensional function-on-function regression problem, and we show how to extend it to the scalar-on-function framework. Our method combines functional data, optimization, and machine learning techniques to perform feature selection and parameter estimation simultaneously. We exploit the properties of Functional Principal Components, and the sparsity inherent to the Dual Augmented Lagrangian problem to significantly reduce computational cost, and we introduce an adaptive scheme to improve selection accuracy. Through an extensive simulation study, we benchmark our approach to the best existing competitors and demonstrate a massive gain in terms of CPU time and selection performance without sacrificing the quality of the coefficients' estimation. Finally, we present an application to brain fMRI data from the AOMIC PIOP1 study.

READ FULL TEXT
research
07/05/2021

Multivariate functional group sparse regression: functional predictor selection

In this paper, we propose methods for functional predictor selection and...
research
05/23/2012

Efficient Sparse Group Feature Selection via Nonconvex Optimization

Sparse feature selection has been demonstrated to be effective in handli...
research
10/08/2013

Feature Selection Strategies for Classifying High Dimensional Astronomical Data Sets

The amount of collected data in many scientific fields is increasing, al...
research
09/21/2016

Saturating Splines and Feature Selection

We extend the adaptive regression spline model by incorporating saturati...
research
06/06/2020

An Efficient Semi-smooth Newton Augmented Lagrangian Method for Elastic Net

Feature selection is an important and active research area in statistics...
research
10/26/2020

BEAR: Sketching BFGS Algorithm for Ultra-High Dimensional Feature Selection in Sublinear Memory

We consider feature selection for applications in machine learning where...
research
09/25/2018

Sparse-Group Bayesian Feature Selection Using Expectation Propagation for Signal Recovery and Network Reconstruction

We present a Bayesian method for feature selection in the presence of gr...

Please sign up or login with your details

Forgot password? Click here to reset