DeepAI AI Chat
Log In Sign Up

Does Dataset Complexity Matters for Model Explainers?

07/06/2021
by   José Ribeiro, et al.
0

Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI-based tools used today explain these types of models, generating attribute rankings aimed at explaining the same, that is, the analysis of Attribute Importance. There is no consensus on which XAI tool generates a general rank of explainability, for this reason, several proposals for tools have emerged (Ciu, Dalex, Eli5, Lofo, Shap and Skater). Here, we present an experimental benchmark of explainable AI techniques capable of producing model-agnostic global explainability ranks based on tabular data related to different problems. Seeking to answer questions such as "Are the explanations generated by the different tools the same, similar or different?" and "How does data complexity play along model explainability?". The results from the construction of 82 computational models and 592 ranks give us some light on the other side of the problem of explainability: dataset complexity!

READ FULL TEXT

page 1

page 2

page 3

page 4

10/18/2022

Global Explanation of Tree-Ensembles Models Based on Item Response Theory

Explainable Artificial Intelligence - XAI is aimed at studying and devel...
04/06/2021

Towards a Rigorous Evaluation of Explainability for Multivariate Time Series

Machine learning-based systems are rapidly gaining popularity and in-lin...
08/15/2020

Explainability in Deep Reinforcement Learning

A large set of the explainable Artificial Intelligence (XAI) literature ...
07/21/2021

GLIME: A new graphical methodology for interpretable model-agnostic explanations

Explainable artificial intelligence (XAI) is an emerging new domain in w...
06/07/2022

Explainability in Mechanism Design: Recent Advances and the Road Ahead

Designing and implementing explainable systems is seen as the next step ...
01/03/2023

Explaining Imitation Learning through Frames

As one of the prevalent methods to achieve automation systems, Imitation...
11/05/2019

Why X rather than Y? Explaining Neural Model' Predictions by Generating Intervention Counterfactual Samples

Even though the topic of explainable AI/ML is very popular in text and c...