Learning Optimal Predictive Checklists

by   Haoran Zhang, et al.

Checklists are simple decision aids that are often used to promote safety and reliability in clinical applications. In this paper, we present a method to learn checklists for clinical decision support. We represent predictive checklists as discrete linear classifiers with binary features and unit weights. We then learn globally optimal predictive checklists from data by solving an integer programming problem. Our method allows users to customize checklists to obey complex constraints, including constraints to enforce group fairness and to binarize real-valued features at training time. In addition, it pairs models with an optimality gap that can inform model development and determine the feasibility of learning sufficiently accurate checklists on a given dataset. We pair our method with specialized techniques that speed up its ability to train a predictive checklist that performs well and has a small optimality gap. We benchmark the performance of our method on seven clinical classification problems, and demonstrate its practical benefits by training a short-form checklist for PTSD screening. Our results show that our method can fit simple predictive checklists that perform well and that can easily be customized to obey a rich class of custom constraints.



There are no comments yet.


page 1

page 2

page 3

page 4


Predictive Multiplicity in Classification

In the context of machine learning, a prediction problem exhibits predic...

Learning Optimized Risk Scores on Large-Scale Datasets

Risk scores are simple classification models that let users quickly asse...

Optimal Transport of Binary Classifiers to Fairness

Much of the past work on fairness in machine learning has focused on for...

Careful! Training Relevance is Real

There is a recent proliferation of research on the integration of machin...

Optimal Training of Fair Predictive Models

Recently there has been sustained interest in modifying prediction algor...

Binary Classification Using Neural and Clinical Features: An Application in Fibromyalgia With Likelihood-Based Decision Level Fusion.

Among several features used for clinical binary classification, behavior...

Teaching the Old Dog New Tricks: Supervised Learning with Constraints

Methods for taking into account external knowledge in Machine Learning m...

Code Repositories


Creating predictive checklists from data using integer programming.

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.