DeepAI AI Chat
Log In Sign Up

On Explaining Decision Trees

10/21/2020
by   Yacine Izza, et al.
0

Decision trees (DTs) epitomize what have become to be known as interpretable machine learning (ML) models. This is informally motivated by paths in DTs being often much smaller than the total number of features. This paper shows that in some settings DTs can hardly be deemed interpretable, with paths in a DT being arbitrarily larger than a PI-explanation, i.e. a subset-minimal set of feature values that entails the prediction. As a result, the paper proposes a novel model for computing PI-explanations of DTs, which enables computing one PI-explanation in polynomial time. Moreover, it is shown that enumeration of PI-explanations can be reduced to the enumeration of minimal hitting sets. Experimental results were obtained on a wide range of publicly available datasets with well-known DT-learning tools, and confirm that in most cases DTs have paths that are proper supersets of PI-explanations.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/20/2022

On Tackling Explanation Redundancy in Decision Trees

Decision trees (DTs) epitomize the ideal of interpretability of machine ...
06/02/2021

On Efficiently Explaining Graph-Based Classifiers

Recent work has shown that not only decision trees (DTs) may not be inte...
05/14/2021

SAT-Based Rigorous Explanations for Decision Lists

Decision lists (DLs) find a wide range of uses for classification proble...
06/11/2020

How Interpretable and Trustworthy are GAMs?

Generalized additive models (GAMs) have become a leading model class for...
03/03/2021

Extracting Optimal Explanations for Ensemble Trees via Logical Reasoning

Ensemble trees are a popular machine learning model which often yields h...
09/29/2022

Understanding Interventional TreeSHAP : How and Why it Works

Shapley values are ubiquitous in interpretable Machine Learning due to t...
10/27/2022

Feature Necessity Relevancy in ML Classifier Explanations

Given a machine learning (ML) model and a prediction, explanations can b...