Reflection on modern methods: Good practices for applied statistical learning in epidemiology

by   Yanelli Nunez, et al.

Statistical learning (SL) includes methods that extract knowledge from complex data. SL methods beyond generalized linear models are being increasingly implemented in public health research and epidemiology because they can perform better in instances with complex or high-dimensional data—settings when traditional statistical methods fail. These novel methods, however, often include random sampling which may induce variability in results. Best practices in data science can help to ensure robustness. As a case study, we included four SL models that have been applied previously to analyze the relationship between environmental mixtures and health outcomes. We ran each model across 100 initializing values for random number generation, or "seeds," and assessed variability in resulting estimation and inference. All methods exhibited some seed-dependent variability in results. The degree of variability differed across methods and exposure of interest. Any SL method reliant on a random seed will exhibit some degree of seed sensitivity. We recommend that researchers repeat their analysis with various seeds as a sensitivity analysis when implementing these methods to enhance interpretability and robustness of results.



There are no comments yet.


page 1

page 2

page 3

page 4


Bayesian variable selection for multi-dimensional semiparametric regression models

Humans are routinely exposed to mixtures of chemical and other environme...

Investigating the Effect of Intraclass Variability in Temporal Ensembling

Temporal Ensembling is a semi-supervised approach that allows training d...

Best Practices in Scientific Computing

The world is becoming increasingly complex, both in terms of the rich so...

Estimation and Sensitivity Analysis for Causal Decomposition in Heath Disparity Research

In the field of disparities research, there has been growing interest in...

Individual predictions matter: Assessing the effect of data ordering in training fine-tuned CNNs for medical imaging

We reproduced the results of CheXNet with fixed hyperparameters and 50 d...

Machine learning approaches to identify thresholds in a heat-health warning system context

During the last two decades, a number of countries or cities established...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.