Saturating Splines and Feature Selection

09/21/2016
by   Nicholas Boyd, et al.
0

We extend the adaptive regression spline model by incorporating saturation, the natural requirement that a function extend as a constant outside a certain range. We fit saturating splines to data using a convex optimization problem over a space of measures, which we solve using an efficient algorithm based on the conditional gradient method. Unlike many existing approaches, our algorithm solves the original infinite-dimensional (for splines of degree at least two) optimization problem without pre-specified knot locations. We then adapt our algorithm to fit generalized additive models with saturating splines as coordinate functions and show that the saturation requirement allows our model to simultaneously perform feature selection and nonlinear function fitting. Finally, we briefly sketch how the method can be extended to higher order splines and to different requirements on the extension outside the data range.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2015

Direct l_(2,p)-Norm Learning for Feature Selection

In this paper, we propose a novel sparse learning based feature selectio...
research
03/26/2023

FAStEN: an efficient adaptive method for feature selection and estimation in high-dimensional functional regressions

Functional regression analysis is an established tool for many contempor...
research
06/07/2023

Sparse Linear Centroid-Encoder: A Convex Method for Feature Selection

We present a novel feature selection technique, Sparse Linear Centroid-E...
research
07/28/2019

Adaptive spline fitting with particle swarm optimization

In fitting data with a spline, finding the optimal placement of knots ca...
research
05/19/2019

Good Feature Selection for Least Squares Pose Optimization in VO/VSLAM

This paper aims to select features that contribute most to the pose esti...
research
02/28/2022

Fast Feature Selection with Fairness Constraints

We study the fundamental problem of selecting optimal features for model...
research
06/16/2020

Additive Poisson Process: Learning Intensity of Higher-Order Interaction in Stochastic Processes

We present the Additive Poisson Process (APP), a novel framework that ca...

Please sign up or login with your details

Forgot password? Click here to reset