Ridge regression with adaptive additive rectangles and other piecewise functional templates

11/02/2020
by   Edoardo Belli, et al.
0

We propose an L_2-based penalization algorithm for functional linear regression models, where the coefficient function is shrunk towards a data-driven shape template γ, which is constrained to belong to a class of piecewise functions by restricting its basis expansion. In particular, we focus on the case where γ can be expressed as a sum of q rectangles that are adaptively positioned with respect to the regression error. As the problem of finding the optimal knot placement of a piecewise function is nonconvex, the proposed parametrization allows to reduce the number of variables in the global optimization scheme, resulting in a fitting algorithm that alternates between approximating a suitable template and solving a convex ridge-like problem. The predictive power and interpretability of our method is shown on multiple simulations and two real world case studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2021

Piecewise linear regression and classification

This paper proposes a method for solving multivariate regression and cla...
research
10/31/2020

Smoothly Adaptively Centered Ridge Estimator

With a focus on linear models with smooth functional covariates, we prop...
research
07/05/2020

Piecewise Linear Regression via a Difference of Convex Functions

We present a new piecewise linear regression methodology that utilizes f...
research
07/09/2021

Linear/Ridge expansions: Enhancing linear approximations by ridge functions

We consider approximations formed by the sum of a linear combination of ...
research
09/27/2022

Computing Melodic Templates in Oral Music Traditions

The term melodic template or skeleton refers to a basic melody which is ...
research
02/06/2022

HARFE: Hard-Ridge Random Feature Expansion

We propose a random feature model for approximating high-dimensional spa...
research
01/21/2022

Tuned Regularized Estimators for Linear Regression via Covariance Fitting

We consider the problem of finding tuned regularized parameter estimator...

Please sign up or login with your details

Forgot password? Click here to reset