Explaining Deep Learning Models with Constrained Adversarial Examples

06/25/2019
by   Jonathan Moore, et al.
0

Machine learning algorithms generally suffer from a problem of explainability. Given a classification result from a model, it is typically hard to determine what caused the decision to be made, and to give an informative explanation. We explore a new method of generating counterfactual explanations, which instead of explaining why a particular classification was made explain how a different outcome can be achieved. This gives the recipients of the explanation a better way to understand the outcome, and provides an actionable suggestion. We show that the introduced method of Constrained Adversarial Examples (CADEX) can be used in real world applications, and yields explanations which incorporate business or domain constraints such as handling categorical attributes and range constraints.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2020

Semantics and explanation: why counterfactual explanations produce adversarial examples in deep neural networks

Recent papers in explainable AI have made a compelling case for counterf...
research
06/18/2021

On the Connections between Counterfactual Explanations and Adversarial Examples

Counterfactual explanations and adversarial examples have emerged as cri...
research
05/31/2022

MACE: An Efficient Model-Agnostic Framework for Counterfactual Explanation

Counterfactual explanation is an important Explainable AI technique to e...
research
10/20/2020

Counterfactual Explanations for Machine Learning: A Review

Machine learning plays a role in many deployed decision systems, often i...
research
01/24/2023

Explainable Data-Driven Optimization: From Context to Decision and Back Again

Data-driven optimization uses contextual information and machine learnin...
research
04/07/2022

Finding Counterfactual Explanations through Constraint Relaxations

Interactive constraint systems often suffer from infeasibility (no solut...

Please sign up or login with your details

Forgot password? Click here to reset