DeepAI AI Chat
Log In Sign Up

Toward Policy Explanations for Multi-Agent Reinforcement Learning

04/26/2022
by   Kayla Boggess, et al.
University of Virginia
Bar-Ilan University
7

Advances in multi-agent reinforcement learning (MARL) enable sequential decision making for a range of exciting multi-agent applications such as cooperative AI and autonomous driving. Explaining agent decisions is crucial for improving system transparency, increasing user satisfaction, and facilitating human-agent collaboration. However, existing works on explainable reinforcement learning mostly focus on the single-agent setting and are not suitable for addressing challenges posed by multi-agent environments. We present novel methods to generate two types of policy explanations for MARL: (i) policy summarization about the agent cooperation and task sequence, and (ii) language explanations to answer queries about agent behavior. Experimental results on three MARL domains demonstrate the scalability of our methods. A user study shows that the generated explanations significantly improve user performance and increase subjective ratings on metrics such as user satisfaction.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/17/2023

Explainable Multi-Agent Reinforcement Learning for Temporal Queries

As multi-agent reinforcement learning (MARL) systems are increasingly de...
10/10/2019

AI for Explaining Decisions in Multi-Agent Environments

Explanation is necessary for humans to understand and accept decisions m...
02/21/2023

Causal Social Explanations for Stochastic Sequential Multi-Agent Decision-Making

We present a novel framework to generate causal explanations for the dec...
08/04/2020

Explanation of Reinforcement Learning Model in Dynamic Multi-Agent System

Recently, there has been increasing interest in transparency and interpr...
09/26/2022

MARLUI: Multi-Agent Reinforcement Learning for Goal-Agnostic Adaptive UIs

The goal of Adaptive UIs is to automatically change an interface so that...
05/26/2021

Explaining Ridesharing: Selection of Explanations for Increasing User Satisfaction

Transportation services play a crucial part in the development of modern...