Counterfactual Explanations in Sequential Decision Making Under Uncertainty

07/06/2021
by   Stratis Tsirtsis, et al.
0

Methods to find counterfactual explanations have predominantly focused on one step decision making processes. In this work, we initiate the development of methods to find counterfactual explanations for decision making processes in which multiple, dependent actions are taken sequentially over time. We start by formally characterizing a sequence of actions and states using finite horizon Markov decision processes and the Gumbel-Max structural causal model. Building upon this characterization, we formally state the problem of finding counterfactual explanations for sequential decision making processes. In our problem formulation, the counterfactual explanation specifies an alternative sequence of actions differing in at most k actions from the observed sequence that could have led the observed process realization to a better outcome. Then, we introduce a polynomial time algorithm based on dynamic programming to build a counterfactual policy that is guaranteed to always provide the optimal counterfactual explanation on every possible realization of the counterfactual environment dynamics. We validate our algorithm using both synthetic and real data from cognitive behavioral therapy and show that the counterfactual explanations our algorithm finds can provide valuable insights to enhance sequential decision making under uncertainty.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2023

Finding Counterfactually Optimal Action Sequences in Continuous State Spaces

Humans performing tasks that involve taking a series of multiple depende...
research
06/05/2022

Sequential Counterfactual Decision-Making Under Confounded Reward

We investigate the limitations of random trials when the cause of intere...
research
11/15/2021

Counterfactual Temporal Point Processes

Machine learning models based on temporal point processes are the state ...
research
03/30/2017

Reliable Decision Support using Counterfactual Models

Making a good decision involves considering the likely outcomes under ea...
research
12/05/2022

This changes to that : Combining causal and non-causal explanations to generate disease progression in capsule endoscopy

Due to the unequivocal need for understanding the decision processes of ...
research
10/21/2022

Augmentation by Counterfactual Explanation – Fixing an Overconfident Classifier

A highly accurate but overconfident model is ill-suited for deployment i...
research
02/21/2023

Causal Social Explanations for Stochastic Sequential Multi-Agent Decision-Making

We present a novel framework to generate causal explanations for the dec...

Please sign up or login with your details

Forgot password? Click here to reset