Contrastive Explanations of Multi-agent Optimization Solutions

08/11/2023
by   Parisa Zehtabi, et al.
0

In many real-world scenarios, agents are involved in optimization problems. Since most of these scenarios are over-constrained, optimal solutions do not always satisfy all agents. Some agents might be unhappy and ask questions of the form “Why does solution S not satisfy property P?”. In this paper, we propose MAoE, a domain-independent approach to obtain contrastive explanations by (i) generating a new solution S^' where the property P is enforced, while also minimizing the differences between S and S^'; and (ii) highlighting the differences between the two solutions. Such explanations aim to help agents understanding why the initial solution is better than what they expected. We have carried out a computational evaluation that shows that MAoE can generate contrastive explanations for large multi-agent optimization problems. We have also performed an extensive user study in four different domains that shows that, after being presented with these explanations, humans' satisfaction with the original solution increases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2023

Explainable Multi-Agent Reinforcement Learning for Temporal Queries

As multi-agent reinforcement learning (MARL) systems are increasingly de...
research
10/10/2019

AI for Explaining Decisions in Multi-Agent Environments

Explanation is necessary for humans to understand and accept decisions m...
research
04/26/2022

Toward Policy Explanations for Multi-Agent Reinforcement Learning

Advances in multi-agent reinforcement learning (MARL) enable sequential ...
research
09/16/2021

Let the CAT out of the bag: Contrastive Attributed explanations for Text

Contrastive explanations for understanding the behavior of black box mod...
research
05/31/2019

Model Agnostic Contrastive Explanations for Structured Data

Recently, a method [7] was proposed to generate contrastive explanations...
research
06/20/2022

Understanding a Robot's Guiding Ethical Principles via Automatically Generated Explanations

The continued development of robots has enabled their wider usage in hum...
research
06/22/2020

Towards Contrastive Explanations for Comparing the Ethics of Plans

The development of robotics and AI agents has enabled their wider usage ...

Please sign up or login with your details

Forgot password? Click here to reset