Valid Inference for L_2-Boosting

05/04/2018
by   David Rügamer, et al.
0

We review several recently proposed post-selection inference frameworks and assess their transferability to the component-wise functional gradient descent algorithm (CFGD) under normality assumption for model errors, also known as L_2-Boosting. The CFGD is one of the most versatile toolboxes to analyze data, as it scales well to high-dimensional data sets, allows for a very flexible definition of additive regression models and incorporates inbuilt variable selection. iterative nature, which can repeatedly select the same component to update, an inference framework for component-wise boosting algorithms requires adaptations of existing approaches; we propose tests and confidence intervals for linear, grouped and penalized additive model components estimated using the L_2-boosting selection process. We apply our framework to the prostate cancer data set and investigate the properties of our concepts in simulation studies. L_2-Boosting as well as for more general gradient-descent boosting algorithms is an sampling approach which constitutes an adoption of the recently proposed method by Yang et al. (2016).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/04/2018

Selective Inference for L_2-Boosting

We review several recently proposed post-selection inference frameworks ...
research
12/31/2017

Estimation and Inference of Treatment Effects with L_2-Boosting in High-Dimensional Settings

Boosting algorithms are very popular in Machine Learning and have proven...
research
02/27/2023

Prediction-based Variable Selection for Component-wise Gradient Boosting

Model-based component-wise gradient boosting is a popular tool for data-...
research
02/03/2022

Deselection of Base-Learners for Statistical Boosting – with an Application to Distributional Regression

We present a new procedure for enhanced variable selection for component...
research
10/07/2021

Accelerated Componentwise Gradient Boosting using Efficient Data Representation and Momentum-based Optimization

Componentwise boosting (CWB), also known as model-based boosting, is a v...
research
09/20/2016

Boosting Factor-Specific Functional Historical Models for the Detection of Synchronisation in Bioelectrical Signals

The link between different psychophysiological measures during emotion e...
research
09/24/2019

The column measure and Gradient-Free Gradient Boosting

Sparse model selection by structural risk minimization leads to a set of...

Please sign up or login with your details

Forgot password? Click here to reset