Optimal Decision Diagrams for Classification

05/28/2022
by   Alexandre M. Florio, et al.
0

Decision diagrams for classification have some notable advantages over decision trees, as their internal connections can be determined at training time and their width is not bound to grow exponentially with their depth. Accordingly, decision diagrams are usually less prone to data fragmentation in internal nodes. However, the inherent complexity of training these classifiers acted as a long-standing barrier to their widespread adoption. In this context, we study the training of optimal decision diagrams (ODDs) from a mathematical programming perspective. We introduce a novel mixed-integer linear programming model for training and demonstrate its applicability for many datasets of practical importance. Further, we show how this model can be easily extended for fairness, parsimony, and stability notions. We present numerical analyses showing that our model allows training ODDs in short computational times, and that ODDs achieve better accuracy than optimal decision trees, while allowing for improved stability without significant accuracy losses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2021

Robust Optimal Classification Trees Against Adversarial Examples

Decision trees are a popular choice of explainable model, but just like ...
research
06/23/2022

Quant-BnB: A Scalable Branch-and-Bound Method for Optimal Decision Trees with Continuous Features

Decision trees are one of the most useful and popular methods in the mac...
research
11/06/2020

A Scalable MIP-based Method for Learning Optimal Multivariate Decision Trees

Several recent publications report advances in training optimal decision...
research
01/20/2021

Dive into Decision Trees and Forests: A Theoretical Demonstration

Based on decision trees, many fields have arguably made tremendous progr...
research
11/16/2021

Multiclass Optimal Classification Trees with SVM-splits

In this paper we present a novel mathematical optimization-based methodo...
research
11/18/2022

A Mathematical Programming Approach to Optimal Classification Forests

In this paper we propose a novel mathematical optimization based methodo...
research
12/02/2021

Learning Optimal Predictive Checklists

Checklists are simple decision aids that are often used to promote safet...

Please sign up or login with your details

Forgot password? Click here to reset