Gradient Boosting for Linear Mixed Models

11/02/2020
by   Colin Griesbach, et al.
0

Gradient boosting from the field of statistical learning is widely known as a powerful framework for estimation and selection of predictor effects in various regression models by adapting concepts from classification theory. Current boosting approaches also offer methods accounting for random effects and thus enable prediction of mixed models for longitudinal and clustered data. However, these approaches include several flaws resulting in unbalanced effect selection with falsely induced shrinkage and a low convergence rate on the one hand and biased estimates of the random effects on the other hand. We therefore propose a new boosting algorithm which explicitly accounts for the random structure by excluding it from the selection procedure, properly correcting the random effects estimates and in addition providing likelihood-based estimation of the random effects variance structure. The new algorithm offers an organic and unbiased fitting approach, which is shown via simulations and data examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2019

Addressing cluster-constant covariates in mixed effects models via likelihood-based boosting techniques

Boosting techniques from the field of statistical learning have grown to...
research
06/09/2021

Bayesian Boosting for Linear Mixed Models

Boosting methods are widely used in statistical learning to deal with hi...
research
09/20/2016

Boosting Factor-Specific Functional Historical Models for the Detection of Synchronisation in Bioelectrical Signals

The link between different psychophysiological measures during emotion e...
research
07/13/2019

Inference for high-dimensional linear mixed-effects models: A quasi-likelihood approach

Linear mixed-effects models are widely used in analyzing clustered or re...
research
11/04/2021

Mixed Models and Shrinkage Estimation for Balanced and Unbalanced Designs

The known connection between shrinkage estimation, empirical Bayes, and ...
research
12/08/2019

VAT tax gap prediction: a 2-steps Gradient Boosting approach

Tax evasion is the illegal non-payment of taxes by individuals, corporat...
research
01/09/2022

Information Borrowing in Regression Models

Model development often takes data structure, subject matter considerati...

Please sign up or login with your details

Forgot password? Click here to reset