X-CAL: Explicit Calibration for Survival Analysis

by   Mark Goldstein, et al.

Survival analysis models the distribution of time until an event of interest, such as discharge from the hospital or admission to the ICU. When a model's predicted number of events within any time interval is similar to the observed number, it is called well-calibrated. A survival model's calibration can be measured using, for instance, distributional calibration (D-CALIBRATION) [Haider et al., 2020] which computes the squared difference between the observed and predicted number of events within different time intervals. Classically, calibration is addressed in post-training analysis. We develop explicit calibration (X-CAL), which turns D-CALIBRATION into a differentiable objective that can be used in survival modeling alongside maximum likelihood estimation and other objectives. X-CAL allows practitioners to directly optimize calibration and strike a desired balance between predictive power and calibration. In our experiments, we fit a variety of shallow and deep models on simulated data, a survival dataset based on MNIST, on length-of-stay prediction using MIMIC-III data, and on brain cancer data from The Cancer Genome Atlas. We show that the models we study can be miscalibrated. We give experimental evidence on these datasets that X-CAL improves D-CALIBRATION without a large decrease in concordance or likelihood.



There are no comments yet.


page 1

page 2

page 3

page 4


Countdown Regression: Sharp and Calibrated Survival Predictions

Personalized probabilistic forecasts of time to event (such as mortality...

Inverse-Weighted Survival Games

Deep models trained through maximum likelihood have achieved state-of-th...

A novel calibration framework for survival analysis when a binary covariate is measured at sparse time points

The goals in clinical and cohort studies often include evaluation of the...

Survival Function Matching for Calibrated Time-to-Event Predictions

Models for predicting the time of a future event are crucial for risk as...

Consistent and robust inference in hazard probability and odds models with discrete-time survival data

For discrete-time survival data, conditional likelihood inference in Cox...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.