A Survey on Graph Counterfactual Explanations: Definitions, Methods, Evaluation

In recent years, Graph Neural Networks have reported outstanding performance in tasks like community detection, molecule classification and link prediction. However, the black-box nature of these models prevents their application in domains like health and finance, where understanding the models' decisions is essential. Counterfactual Explanations (CE) provide these understandings through examples. Moreover, the literature on CE is flourishing with novel explanation methods which are tailored to graph learning. In this survey, we analyse the existing Graph Counterfactual Explanation methods, by providing the reader with an organisation of the literature according to a uniform formal notation for definitions, datasets, and metrics, thus, simplifying potential comparisons w.r.t to the method advantages and disadvantages. We discussed seven methods and sixteen synthetic and real datasets providing details on the possible generation strategies. We highlight the most common evaluation strategies and formalise nine of the metrics used in the literature. We first introduce the evaluation framework GRETEL and how it is possible to extend and use it while providing a further dimension of comparison encompassing reproducibility aspects. Finally, we provide a discussion on how counterfactual explanation interplays with privacy and fairness, before delving into open challenges and future works.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2022

GRETEL: A unified framework for Graph Counterfactual Explanation Evaluation

Machine Learning (ML) systems are a building part of the modern tools wh...
research
02/26/2021

If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques

In recent years, there has been an explosion of AI research on counterfa...
research
06/16/2021

Counterfactual Graphs for Explainable Classification of Brain Networks

Training graph classifiers able to distinguish between healthy brains an...
research
07/27/2023

Counterfactual Explanations for Graph Classification Through the Lenses of Density

Counterfactual examples have emerged as an effective approach to produce...
research
10/30/2021

On Quantitative Evaluations of Counterfactuals

As counterfactual examples become increasingly popular for explaining de...
research
08/02/2021

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms

Counterfactual explanations provide means for prescriptive model explana...
research
05/13/2022

DualCF: Efficient Model Extraction Attack from Counterfactual Explanations

Cloud service providers have launched Machine-Learning-as-a-Service (MLa...

Please sign up or login with your details

Forgot password? Click here to reset