Ordinal Neural Network Transformation Models: Deep and interpretable regression models for ordinal outcomes

10/16/2020
by   Lucas Kook, et al.
0

Outcomes with a natural order commonly occur in prediction tasks and oftentimes the available input data are a mixture of complex data, like images, and tabular predictors. Although deep Learning (DL) methods have shown outstanding performance on image classification, most models treat ordered outcomes as unordered and lack interpretability. In contrast, classical ordinal regression models yield interpretable predictor effects but are limited to tabular input data. Here, we present the highly modular class of ordinal neural network transformation models (ONTRAMs). Transformation models use a parametric transformation function and a simple distribution to trade off flexibility and interpretability of individual model components. In ONTRAMs, this trade-off is achieved by additively decomposing the transformation function into terms for the tabular and image data using a set of jointly trained neural networks. We show that the most flexible ONTRAMs achieve on-par performance with DL classifiers while outperforming them in training speed. We discuss how to interpret components of ONTRAMs in general and in the case of correlated tabular and image data. Taken together, ONTRAMs join benefits of DL and distributional regression to create interpretable prediction models for ordinal outcomes.

READ FULL TEXT

page 29

page 31

research
06/27/2022

Deep transformation models for functional outcome prediction after acute ischemic stroke

For many medical applications, interpretable models with a high predicti...
research
04/01/2020

Deep transformation models: Tackling complex regression problems with neural network based transformation models

We present a deep transformation model for probabilistic regression. Dee...
research
11/24/2022

Estimating Conditional Distributions with Neural Networks using R package deeptrafo

Contemporary empirical applications frequently require flexible regressi...
research
01/20/2021

Distributional Anchor Regression

Prediction models often fail if train and test data do not stem from the...
research
10/15/2020

Deep Conditional Transformation Models

Learning the cumulative distribution function (CDF) of an outcome variab...
research
02/10/2022

The leap to ordinal: functional prognosis after traumatic brain injury using artificial intelligence

When a patient is admitted to the intensive care unit (ICU) after a trau...
research
01/23/2019

Ordinal Probit Functional Regression Models with Application to Computer-Use Behavior in Rhesus Monkeys

Research in functional regression has made great strides in expanding to...

Please sign up or login with your details

Forgot password? Click here to reset