Synthesizing explainable counterfactual policies for algorithmic recourse with program synthesis

01/18/2022
by   Giovanni De Toni, et al.
0

Being able to provide counterfactual interventions - sequences of actions we would have had to take for a desirable outcome to happen - is essential to explain how to change an unfavourable decision by a black-box machine learning model (e.g., being denied a loan request). Existing solutions have mainly focused on generating feasible interventions without providing explanations on their rationale. Moreover, they need to solve a separate optimization problem for each user. In this paper, we take a different approach and learn a program that outputs a sequence of explainable counterfactual actions given a user description and a causal graph. We leverage program synthesis techniques, reinforcement learning coupled with Monte Carlo Tree Search for efficient exploration, and rule learning to extract explanations for each recommended action. An experimental evaluation on synthetic and real-world datasets shows how our approach generates effective interventions by making orders of magnitude fewer queries to the black-box classifier with respect to existing solutions, with the additional benefit of complementing them with interpretable explanations.

READ FULL TEXT
research
05/27/2022

Generating personalized counterfactual interventions for algorithmic recourse by eliciting user preferences

Counterfactual interventions are a powerful tool to explain the decision...
research
11/17/2022

Features Compression based on Counterfactual Analysis

Counterfactual Explanations are becoming a de-facto standard in post-hoc...
research
08/14/2023

Explaining Black-Box Models through Counterfactuals

We present CounterfactualExplanations.jl: a package for generating Count...
research
06/07/2021

Amortized Generation of Sequential Counterfactual Explanations for Black-box Models

Explainable machine learning (ML) has gained traction in recent years du...
research
06/14/2021

Counterfactual Explanations as Interventions in Latent Space

Explainable Artificial Intelligence (XAI) is a set of techniques that al...
research
04/12/2021

Consequence-aware Sequential Counterfactual Generation

Counterfactuals have become a popular technique nowadays for interacting...
research
05/13/2022

DualCF: Efficient Model Extraction Attack from Counterfactual Explanations

Cloud service providers have launched Machine-Learning-as-a-Service (MLa...

Please sign up or login with your details

Forgot password? Click here to reset