A Survey of Evaluation Methods and Measures for Interpretable Machine Learning

11/28/2018
by   Sina Mohseni, et al.
0

The need for interpretable and accountable intelligent system gets sensible as artificial intelligence plays more role in human life. Explainable artificial intelligence systems can be a solution by self-explaining the reasoning behind the decisions and predictions of the intelligent system. Researchers from different disciplines work together to define, design and evaluate interpretable intelligent systems for the user. Our work supports the different evaluation goals in interpretable machine learning research by a thorough review of evaluation methodologies used in machine-explanation research across the fields of human-computer interaction, visual analytics, and machine learning. We present a 2D categorization of interpretable machine learning evaluation methods and show a mapping between user groups and evaluation measures. Further, we address the essential factors and steps for a right evaluation plan by proposing a nested model for design and evaluation of explainable artificial intelligence systems.

READ FULL TEXT
research
03/27/2020

Machine Learning in Artificial Intelligence: Towards a Common Understanding

The application of "machine learning" and "artificial intelligence" has ...
research
09/14/2020

Should We Trust (X)AI? Design Dimensions for Structured Experimental Evaluations

This paper systematically derives design dimensions for the structured e...
research
09/04/2023

CONFIDERAI: a novel CONFormal Interpretable-by-Design score function for Explainable and Reliable Artificial Intelligence

Everyday life is increasingly influenced by artificial intelligence, and...
research
10/06/2022

Why Should I Choose You? AutoXAI: A Framework for Selecting and Tuning eXplainable AI Solutions

In recent years, a large number of XAI (eXplainable Artificial Intellige...
research
06/15/2023

Towards Interpretability in Audio and Visual Affective Machine Learning: A Review

Machine learning is frequently used in affective computing, but presents...
research
05/13/2020

Explainable Reinforcement Learning: A Survey

Explainable Artificial Intelligence (XAI), i.e., the development of more...
research
06/18/2021

Rational Shapley Values

Explaining the predictions of opaque machine learning algorithms is an i...

Please sign up or login with your details

Forgot password? Click here to reset