Strategies for variable selection in large-scale healthcare database studies with missing covariate and outcome data

07/20/2021
by   Jung-Yi Joyce Lin, et al.
0

Prior work has shown that combining bootstrap imputation with tree-based machine learning variable selection methods can recover the good performance achievable on fully observed data when covariate and outcome data are missing at random (MAR). This approach however is computationally expensive, especially on large-scale datasets. We propose an inference-based method RR-BART, that leverages the likelihood-based Bayesian machine learning technique, Bayesian Additive Regression Trees, and uses Rubin's rule to combine the estimates and variances of the variable importance measures on multiply imputed datasets for variable selection in the presence of missing data. A representative simulation study suggests that RR-BART performs at least as well as combining bootstrap with BART, BI-BART, but offers substantial computational savings, even in complex conditions of nonlinearity and nonadditivity with a large percentage of overall missingness under the MAR mechanism. RR-BART is also less sensitive to the end note prior via the hyperparameter k than BI-BART, and does not depend on the selection threshold value π as required by BI-BART. Our simulation studies also suggest that encoding the missing values of a binary predictor as a separate category significantly improves the power of selecting the binary predictor for BI-BART. We further demonstrate the methods via a case study of risk factors for 3-year incidence of metabolic syndrome with data from the Study of Women's Health Across the Nation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2021

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

The missing data issue is ubiquitous in health studies. Variable selecti...
research
10/31/2022

Variable Selection for Multiply-imputed Data: A Bayesian Framework

Multiple imputation is a widely used technique to handle missing data in...
research
03/30/2022

A comparison of strategies for selecting auxiliary variables for multiple imputation

Multiple imputation (MI) is a popular method for handling missing data. ...
research
11/10/2021

variable selection and missing data imputation in categorical genomic data analysis by integrated ridge regression and random forest

Genomic data arising from a genome-wide association study (GWAS) are oft...
research
02/26/2022

Missing Value Knockoffs

One limitation of the most statistical/machine learning-based variable s...
research
03/30/2023

KOO approach for scalable variable selection problem in large-dimensional regression

An important issue in many multivariate regression problems is to elimin...
research
11/06/2021

In Nonparametric and High-Dimensional Models, Bayesian Ignorability is an Informative Prior

In problems with large amounts of missing data one must model two distin...

Please sign up or login with your details

Forgot password? Click here to reset