Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvement

03/15/2022
by   Leander Weber, et al.
0

Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box classifiers in recent years, these tools are seldomly used beyond visualization purposes. Only recently, researchers have started to employ explanations in practice to actually improve models. This paper offers a comprehensive overview over techniques that apply XAI practically for improving various properties of ML models, and systematically categorizes these approaches, comparing their respective strengths and weaknesses. We provide a theoretical perspective on these methods, and show empirically through experiments on toy and realistic settings how explanations can help improve properties such as model generalization ability or reasoning, among others. We further discuss potential caveats and drawbacks of these methods. We conclude that while model improvement based on XAI can have significant beneficial effects even on complex and not easily quantifyable model properties, these methods need to be applied carefully, since their success can vary depending on a multitude of factors, such as the model and dataset used, or the employed explanation method.

READ FULL TEXT

page 4

page 22

research
06/01/2021

To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods

The main objective of eXplainable Artificial Intelligence (XAI) is to pr...
research
06/14/2021

Pitfalls of Explainable ML: An Industry Perspective

As machine learning (ML) systems take a more prominent and central role ...
research
07/13/2022

Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities

The application of Artificial Intelligence (AI) and Machine Learning (ML...
research
11/11/2022

Explainability in Practice: Estimating Electrification Rates from Mobile Phone Data in Senegal

Explainable artificial intelligence (XAI) provides explanations for not ...
research
05/01/2020

The Grammar of Interactive Explanatory Model Analysis

When analysing a complex system, very often an answer for one question r...
research
12/07/2022

Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning

As the societal impact of Deep Neural Networks (DNNs) grows, the goals f...
research
09/26/2019

Towards Explainable Artificial Intelligence

In recent years, machine learning (ML) has become a key enabling technol...

Please sign up or login with your details

Forgot password? Click here to reset