Conceptual Views on Tree Ensemble Classifiers

02/10/2023
by   Tom Hanika, et al.
0

Random Forests and related tree-based methods are popular for supervised learning from table based data. Apart from their ease of parallelization, their classification performance is also superior. However, this performance, especially parallelizability, is offset by the loss of explainability. Statistical methods are often used to compensate for this disadvantage. Yet, their ability for local explanations, and in particular for global explanations, is limited. In the present work we propose an algebraic method, rooted in lattice theory, for the (global) explanation of tree ensembles. In detail, we introduce two novel conceptual views on tree ensemble classifiers and demonstrate their explanatory capabilities on Random Forests that were trained with standard parameters.

READ FULL TEXT
research
09/11/2020

TREX: Tree-Ensemble Representer-Point Explanations

How can we identify the training examples that contribute most to the pr...
research
09/30/2021

On the Trustworthiness of Tree Ensemble Explainability Methods

The recent increase in the deployment of machine learning models in crit...
research
04/28/2015

Explaining the Success of AdaBoost and Random Forests as Interpolating Classifiers

There is a large literature explaining why AdaBoost is a successful clas...
research
11/21/2022

Explaining Random Forests using Bipolar Argumentation and Markov Networks (Technical Report)

Random forests are decision tree ensembles that can be used to solve a v...
research
10/29/2020

Analyzing the tree-layer structure of Deep Forests

Random forests on the one hand, and neural networks on the other hand, h...
research
07/20/2019

Estimating the Algorithmic Variance of Randomized Ensembles via the Bootstrap

Although the methods of bagging and random forests are some of the most ...
research
04/29/2022

A study of tree-based methods and their combination

Tree-based methods are popular machine learning techniques used in vario...

Please sign up or login with your details

Forgot password? Click here to reset