Robust Counterfactual Explanations for Tree-Based Ensembles

07/06/2022
by   Sanghamitra Dutta, et al.
0

Counterfactual explanations inform ways to achieve a desired outcome from a machine learning model. However, such explanations are not robust to certain real-world changes in the underlying model (e.g., retraining the model, changing hyperparameters, etc.), questioning their reliability in several applications, e.g., credit lending. In this work, we propose a novel strategy – that we call RobX – to generate robust counterfactuals for tree-based ensembles, e.g., XGBoost. Tree-based ensembles pose additional challenges in robust counterfactual generation, e.g., they have a non-smooth and non-differentiable objective function, and they can change a lot in the parameter space under retraining on very similar data. We first introduce a novel metric – that we call Counterfactual Stability – that attempts to quantify how robust a counterfactual is going to be to model changes under retraining, and comes with desirable theoretical properties. Our proposed strategy RobX works with any counterfactual generation method (base method) and searches for robust counterfactuals by iteratively refining the counterfactual generated by the base method using our metric Counterfactual Stability. We compare the performance of RobX with popular counterfactual generation methods (for tree-based ensembles) across benchmark datasets. The results demonstrate that our strategy generates counterfactuals that are significantly more robust (nearly 100 of local outlier factor) over existing state-of-the-art methods.

READ FULL TEXT
research
11/27/2019

Actionable Interpretability through Optimizable Counterfactual Explanations for Tree Ensembles

Counterfactual explanations help users understand why machine learned mo...
research
05/19/2023

Robust Counterfactual Explanations for Neural Networks With Probabilistic Guarantees

There is an emerging interest in generating robust counterfactual explan...
research
09/29/2022

Rethinking Counterfactual Explanations as Local and Regional Counterfactual Policies

Among the challenges not yet resolved for Counterfactual Explanations (C...
research
08/31/2022

Formalising the Robustness of Counterfactual Explanations for Neural Networks

The use of counterfactual explanations (CFXs) is an increasingly popular...
research
10/27/2021

Counterfactual Shapley Additive Explanations

Feature attributions are a common paradigm for model explanations due to...
research
09/13/2021

DisCERN:Discovering Counterfactual Explanations using Relevance Features from Neighbourhoods

Counterfactual explanations focus on "actionable knowledge" to help end-...
research
06/11/2021

Optimal Counterfactual Explanations in Tree Ensembles

Counterfactual explanations are usually generated through heuristics tha...

Please sign up or login with your details

Forgot password? Click here to reset