DeepAI AI Chat
Log In Sign Up

Massive Parallelization of Massive Sample-size Survival Analysis

by   Jianxiao Yang, et al.

Large-scale observational health databases are increasingly popular for conducting comparative effectiveness and safety studies of medical products. However, increasing number of patients poses computational challenges when fitting survival regression models in such studies. In this paper, we use graphics processing units (GPUs) to parallelize the computational bottlenecks of massive sample-size survival analyses. Specifically, we develop and apply time- and memory-efficient single-pass parallel scan algorithms for Cox proportional hazards models and forward-backward parallel scan algorithms for Fine-Gray models for analysis with and without a competing risk using a cyclic coordinate descent optimization approach We demonstrate that GPUs accelerate the computation of fitting these complex models in large databases by orders-of-magnitude as compared to traditional multi-core CPU parallelism. Our implementation enables efficient large-scale observational studies involving millions of patients and thousands of patient characteristics.


Scalable Sparse Cox's Regression for Large-Scale Survival Data via Broken Adaptive Ridge

This paper develops a new sparse Cox regression method for high-dimensio...

Scalable Algorithms for Large Competing Risks Data

This paper develops two orthogonal contributions to scalable sparse regr...

Optimal Cox Regression Subsampling Procedure with Rare Events

Massive sized survival datasets are becoming increasingly prevalent with...

Sparsity-Specific Code Optimization using Expression Trees

We introduce a code generator that converts unoptimized C++ code operati...

Selective recruitment designs for improving observational studies using electronic health records

Large scale electronic health records (EHRs) present an opportunity to q...

Generalized Mixed Modeling in Massive Electronic Health Record Databases: what is a healthy serum potassium?

Converting electronic health record (EHR) entries to useful clinical inf...