Causal Multi-Agent Reinforcement Learning: Review and Open Problems

11/12/2021
by   St John Grimbly, et al.
0

This paper serves to introduce the reader to the field of multi-agent reinforcement learning (MARL) and its intersection with methods from the study of causality. We highlight key challenges in MARL and discuss these in the context of how causal methods may assist in tackling them. We promote moving toward a 'causality first' perspective on MARL. Specifically, we argue that causality can offer improved safety, interpretability, and robustness, while also providing strong theoretical guarantees for emergent behaviour. We discuss potential solutions for common challenges, and use this context to motivate future research directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2023

Causal Reinforcement Learning: A Survey

Reinforcement learning is an essential paradigm for solving sequential d...
research
02/10/2023

A Survey on Causal Reinforcement Learning

While Reinforcement Learning (RL) achieves tremendous success in sequent...
research
07/31/2023

Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives

The trustworthiness of machine learning has emerged as a critical topic ...
research
03/24/2023

Causality Detection for Efficient Multi-Agent Reinforcement Learning

When learning a task as a team, some agents in Multi-Agent Reinforcement...
research
06/20/2023

Discovering Causality for Efficient Cooperation in Multi-Agent Environments

In cooperative Multi-Agent Reinforcement Learning (MARL) agents are requ...
research
02/01/2023

A Survey of Methods, Challenges and Perspectives in Causality

The Causality field aims to find systematic methods for uncovering cause...

Please sign up or login with your details

Forgot password? Click here to reset