Model-Free Model Reconciliation

03/17/2019
by   Sarath Sreedharan, et al.
32

Designing agents capable of explaining complex sequential decisions remain a significant open problem in automated decision-making. Recently, there has been a lot of interest in developing approaches for generating such explanations for various decision-making paradigms. One such approach has been the idea of explanation as model-reconciliation. The framework hypothesizes that one of the common reasons for the user's confusion could be the mismatch between the user's model of the task and the one used by the system to generate the decisions. While this is a general framework, most works that have been explicitly built on this explanatory philosophy have focused on settings where the model of user's knowledge is available in a declarative form. Our goal in this paper is to adapt the model reconciliation approach to the cases where such user models are no longer explicitly provided. We present a simple and easy to learn labeling model that can help an explainer decide what information could help achieve model reconciliation between the user and the agent.

READ FULL TEXT
research
06/23/2021

Not all users are the same: Providing personalized explanations for sequential decision making problems

There is a growing interest in designing autonomous agents that can work...
research
02/04/2020

Bridging the Gap: Providing Post-Hoc Symbolic Explanations for Sequential Decision-Making Problems with Black Box Simulators

As more and more complex AI systems are introduced into our day-to-day l...
research
10/21/2022

Integrating Policy Summaries with Reward Decomposition for Explaining Reinforcement Learning Agents

Explaining the behavior of reinforcement learning agents operating in se...
research
01/18/2022

Explainable Decision Making with Lean and Argumentative Explanations

It is widely acknowledged that transparency of automated decision making...
research
05/30/2022

A Unifying Framework for Causal Explanation of Sequential Decision Making

We present a novel framework for causal explanations of stochastic, sequ...
research
03/27/2013

Generating Decision Structures and Causal Explanations for Decision Making

This paper examines two related problems that are central to developing ...
research
09/16/2021

Explainability Requires Interactivity

When explaining the decisions of deep neural networks, simple stories ar...

Please sign up or login with your details

Forgot password? Click here to reset