Deep Multi-Agent Reinforcement Learning with Hybrid Action Spaces based on Maximum Entropy

06/10/2022
by   Hongzhi Hua, et al.
0

Multi-agent deep reinforcement learning has been applied to address a variety of complex problems with either discrete or continuous action spaces and achieved great success. However, most real-world environments cannot be described by only discrete action spaces or only continuous action spaces. And there are few works having ever utilized deep reinforcement learning (drl) to multi-agent problems with hybrid action spaces. Therefore, we propose a novel algorithm: Deep Multi-Agent Hybrid Soft Actor-Critic (MAHSAC) to fill this gap. This algorithm follows the centralized training but decentralized execution (CTDE) paradigm, and extend the Soft Actor-Critic algorithm (SAC) to handle hybrid action space problems in Multi-Agent environments based on maximum entropy. Our experiences are running on an easy multi-agent particle world with a continuous observation and discrete action space, along with some basic simulated physics. The experimental results show that MAHSAC has good performance in training speed, stability, and anti-interference ability. At the same time, it outperforms existing independent deep hybrid learning method in cooperative scenarios and competitive scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/30/2022

A further exploration of deep Multi-Agent Reinforcement Learning with Hybrid Action Space

The research of extending deep reinforcement learning (drl) to multi-age...
research
03/12/2019

Deep Multi-Agent Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces

Deep Reinforcement Learning (DRL) has been applied to address a variety ...
research
12/14/2022

Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems

We consider the sequential decision-making problem of making proactive r...
research
02/23/2023

Revisiting the Gumbel-Softmax in MADDPG

MADDPG is an algorithm in multi-agent reinforcement learning (MARL) that...
research
08/18/2020

Ubiquitous Distributed Deep Reinforcement Learning at the Edge: Analyzing Byzantine Agents in Discrete Action Spaces

The integration of edge computing in next-generation mobile networks is ...
research
03/17/2021

Decentralized Reinforcement Learning for Multi-Target Search and Detection by a Team of Drones

Targets search and detection encompasses a variety of decision problems ...
research
09/20/2023

AI-Driven Patient Monitoring with Multi-Agent Deep Reinforcement Learning

Effective patient monitoring is vital for timely interventions and impro...

Please sign up or login with your details

Forgot password? Click here to reset