X-CAL: Explicit Calibration for Survival Analysis

01/13/2021
by   Mark Goldstein, et al.
0

Survival analysis models the distribution of time until an event of interest, such as discharge from the hospital or admission to the ICU. When a model's predicted number of events within any time interval is similar to the observed number, it is called well-calibrated. A survival model's calibration can be measured using, for instance, distributional calibration (D-CALIBRATION) [Haider et al., 2020] which computes the squared difference between the observed and predicted number of events within different time intervals. Classically, calibration is addressed in post-training analysis. We develop explicit calibration (X-CAL), which turns D-CALIBRATION into a differentiable objective that can be used in survival modeling alongside maximum likelihood estimation and other objectives. X-CAL allows practitioners to directly optimize calibration and strike a desired balance between predictive power and calibration. In our experiments, we fit a variety of shallow and deep models on simulated data, a survival dataset based on MNIST, on length-of-stay prediction using MIMIC-III data, and on brain cancer data from The Cancer Genome Atlas. We show that the models we study can be miscalibrated. We give experimental evidence on these datasets that X-CAL improves D-CALIBRATION without a large decrease in concordance or likelihood.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

06/21/2018

Countdown Regression: Sharp and Calibrated Survival Predictions

Personalized probabilistic forecasts of time to event (such as mortality...
11/16/2021

Inverse-Weighted Survival Games

Deep models trained through maximum likelihood have achieved state-of-th...
01/04/2018

A novel calibration framework for survival analysis when a binary covariate is measured at sparse time points

The goals in clinical and cohort studies often include evaluation of the...
05/21/2019

Survival Function Matching for Calibrated Time-to-Event Predictions

Models for predicting the time of a future event are crucial for risk as...
12/07/2020

Consistent and robust inference in hazard probability and odds models with discrete-time survival data

For discrete-time survival data, conditional likelihood inference in Cox...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.