A Scalable Two Stage Approach to Computing Optimal Decision Sets

02/03/2021
by   Alexey Ignatiev, et al.
0

Machine learning (ML) is ubiquitous in modern life. Since it is being deployed in technologies that affect our privacy and safety, it is often crucial to understand the reasoning behind its decisions, warranting the need for explainable AI. Rule-based models, such as decision trees, decision lists, and decision sets, are conventionally deemed to be the most interpretable. Recent work uses propositional satisfiability (SAT) solving (and its optimization variants) to generate minimum-size decision sets. Motivated by limited practical scalability of these earlier methods, this paper proposes a novel approach to learn minimum-size decision sets by enumerating individual rules of the target decision set independently of each other, and then solving a set cover problem to select a subset of rules. The approach makes use of modern maximum satisfiability and integer linear programming technologies. Experiments on a wide range of publicly available datasets demonstrate the advantage of the new approach over the state of the art in SAT-based decision set learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/29/2020

Computing Optimal Decision Sets with SAT

As machine learning is increasingly used to help make decisions, there i...
research
10/19/2020

Optimal Decision Lists using SAT

Decision lists are one of the most easily explainable machine learning m...
research
05/14/2022

Efficient Learning of Interpretable Classification Rules

Machine learning has become omnipresent with applications in various saf...
research
05/14/2021

SAT-Based Rigorous Explanations for Decision Lists

Decision lists (DLs) find a wide range of uses for classification proble...
research
08/22/2023

Revisiting column-generation-based matheuristic for learning classification trees

Decision trees are highly interpretable models for solving classificatio...
research
08/23/2022

A Nested Genetic Algorithm for Explaining Classification Data Sets with Decision Rules

Our goal in this paper is to automatically extract a set of decision rul...
research
03/21/2022

Optimizing Binary Decision Diagrams with MaxSAT for classification

The growing interest in explainable artificial intelligence (XAI) for cr...

Please sign up or login with your details

Forgot password? Click here to reset