DeepAI AI Chat
Log In Sign Up

Does Dataset Complexity Matters for Model Explainers?

by   José Ribeiro, et al.

Strategies based on Explainable Artificial Intelligence - XAI have emerged in computing to promote a better understanding of predictions made by black box models. Most XAI-based tools used today explain these types of models, generating attribute rankings aimed at explaining the same, that is, the analysis of Attribute Importance. There is no consensus on which XAI tool generates a general rank of explainability, for this reason, several proposals for tools have emerged (Ciu, Dalex, Eli5, Lofo, Shap and Skater). Here, we present an experimental benchmark of explainable AI techniques capable of producing model-agnostic global explainability ranks based on tabular data related to different problems. Seeking to answer questions such as "Are the explanations generated by the different tools the same, similar or different?" and "How does data complexity play along model explainability?". The results from the construction of 82 computational models and 592 ranks give us some light on the other side of the problem of explainability: dataset complexity!


page 1

page 2

page 3

page 4


Global Explanation of Tree-Ensembles Models Based on Item Response Theory

Explainable Artificial Intelligence - XAI is aimed at studying and devel...

Towards a Rigorous Evaluation of Explainability for Multivariate Time Series

Machine learning-based systems are rapidly gaining popularity and in-lin...

Explainability in Deep Reinforcement Learning

A large set of the explainable Artificial Intelligence (XAI) literature ...

GLIME: A new graphical methodology for interpretable model-agnostic explanations

Explainable artificial intelligence (XAI) is an emerging new domain in w...

Explainability in Mechanism Design: Recent Advances and the Road Ahead

Designing and implementing explainable systems is seen as the next step ...

Explaining Imitation Learning through Frames

As one of the prevalent methods to achieve automation systems, Imitation...

Why X rather than Y? Explaining Neural Model' Predictions by Generating Intervention Counterfactual Samples

Even though the topic of explainable AI/ML is very popular in text and c...