Reluctant additive modeling

12/04/2019
by   J. Kenneth Tay, et al.
14

Sparse generalized additive models (GAMs) are an extension of sparse generalized linear models which allow a model's prediction to vary non-linearly with an input variable. This enables the data analyst build more accurate models, especially when the linearity assumption is known to be a poor approximation of reality. Motivated by reluctant interaction modeling (Yu et al. 2019), we propose a multi-stage algorithm, called reluctant additive modeling (RAM), that can fit sparse generalized additive models at scale. It is guided by the principle that, if all else is equal, one should prefer a linear feature over a non-linear feature. Unlike existing methods for sparse GAMs, RAM can be extended easily to binary, count and survival data. We demonstrate the method's effectiveness on real and simulated examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2019

Reluctant generalized additive modeling

Sparse generalized additive models (GAMs) are an extension of sparse gen...
research
06/11/2015

Generalized Additive Model Selection

We introduce GAMSEL (Generalized Additive Model Selection), a penalized ...
research
05/19/2023

Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models

Generalized Additive Models (GAMs) have recently experienced a resurgenc...
research
07/05/2020

Generalized additive models to capture the death rates in Canada COVID-19

To capture the death rates and strong weekly, biweekly and probably mont...
research
06/06/2020

Non Proportional Odds Models are Widely Dispensable – Sparser Modeling based on Parametric and Additive Location-Shift Approaches

The potential of location-shift models to find adequate models between t...
research
09/19/2022

Sparse Interaction Additive Networks via Feature Interaction Detection and Sparse Selection

There is currently a large gap in performance between the statistically ...
research
03/28/2023

Understanding and Exploring the Whole Set of Good Sparse Generalized Additive Models

In real applications, interaction between machine learning model and dom...

Please sign up or login with your details

Forgot password? Click here to reset