The use of the EM algorithm for regularization problems in high-dimensional linear mixed-effects models

08/03/2023
by   Daniela C. R. Oliveira, et al.
0

The EM algorithm is a popular tool for maximum likelihood estimation but has not been used much for high-dimensional regularization problems in linear mixed-effects models. In this paper, we introduce the EMLMLasso algorithm, which combines the EM algorithm and the popular and efficient R package glmnet for Lasso variable selection of fixed effects in linear mixed-effects models. We compare the performance of our proposed EMLMLasso algorithm with the one implemented in the well-known R package glmmLasso through the analyses of both simulated and real-world applications. The simulations and applications demonstrated good properties, such as consistency, and the effectiveness of the proposed variable selection procedure, for both p < n and p > n. Moreover, in all evaluated scenarios, the EMLMLasso algorithm outperformed glmmLasso. The proposed method is quite general and can be easily extended for ridge and elastic net penalties in linear mixed-effects models.

READ FULL TEXT
research
06/02/2022

Bayesian high-dimensional covariate selection in non-linear mixed-effects models using the SAEM algorithm

High-dimensional data, with many more covariates than observations, such...
research
05/24/2018

Convex method for selection of fixed effects in high-dimensional linear mixed models

Analysis of high-dimensional data is currently a popular field of resear...
research
02/13/2022

Misspecification Analysis of High-Dimensional Random Effects Models for Estimation of Signal-to-Noise Ratios

Estimation of signal-to-noise ratios and noise variances in high-dimensi...
research
11/27/2015

Regularized EM Algorithms: A Unified Framework and Statistical Guarantees

Latent variable models are a fundamental modeling tool in machine learni...
research
10/27/2019

f-SAEM: A fast Stochastic Approximation of the EM algorithm for nonlinear mixed effects models

The ability to generate samples of the random effects from their conditi...
research
11/15/2012

Mixed LICORS: A Nonparametric Algorithm for Predictive State Reconstruction

We introduce 'mixed LICORS', an algorithm for learning nonlinear, high-d...
research
11/22/2017

PULasso: High-dimensional variable selection with presence-only data

In various real-world problems, we are presented with positive and unlab...

Please sign up or login with your details

Forgot password? Click here to reset