Learning Optimal Predictive Checklists

12/02/2021
by   Haoran Zhang, et al.
5

Checklists are simple decision aids that are often used to promote safety and reliability in clinical applications. In this paper, we present a method to learn checklists for clinical decision support. We represent predictive checklists as discrete linear classifiers with binary features and unit weights. We then learn globally optimal predictive checklists from data by solving an integer programming problem. Our method allows users to customize checklists to obey complex constraints, including constraints to enforce group fairness and to binarize real-valued features at training time. In addition, it pairs models with an optimality gap that can inform model development and determine the feasibility of learning sufficiently accurate checklists on a given dataset. We pair our method with specialized techniques that speed up its ability to train a predictive checklist that performs well and has a small optimality gap. We benchmark the performance of our method on seven clinical classification problems, and demonstrate its practical benefits by training a short-form checklist for PTSD screening. Our results show that our method can fit simple predictive checklists that perform well and that can easily be customized to obey a rich class of custom constraints.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

09/14/2019

Predictive Multiplicity in Classification

In the context of machine learning, a prediction problem exhibits predic...
10/01/2016

Learning Optimized Risk Scores on Large-Scale Datasets

Risk scores are simple classification models that let users quickly asse...
02/08/2022

Optimal Transport of Binary Classifiers to Fairness

Much of the past work on fairness in machine learning has focused on for...
01/12/2022

Careful! Training Relevance is Real

There is a recent proliferation of research on the integration of machin...
10/09/2019

Optimal Training of Fair Predictive Models

Recently there has been sustained interest in modifying prediction algor...
02/05/2020

Binary Classification Using Neural and Clinical Features: An Application in Fibromyalgia With Likelihood-Based Decision Level Fusion.

Among several features used for clinical binary classification, behavior...
02/25/2020

Teaching the Old Dog New Tricks: Supervised Learning with Constraints

Methods for taking into account external knowledge in Machine Learning m...

Code Repositories

predictive_checklists

Creating predictive checklists from data using integer programming.


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.