KnowSR: Knowledge Sharing among Homogeneous Agents in Multi-agent Reinforcement Learning

05/25/2021
by   Zijian Gao, et al.
0

Recently, deep reinforcement learning (RL) algorithms have made great progress in multi-agent domain. However, due to characteristics of RL, training for complex tasks would be resource-intensive and time-consuming. To meet this challenge, mutual learning strategy between homogeneous agents is essential, which is under-explored in previous studies, because most existing methods do not consider to use the knowledge of agent models. In this paper, we present an adaptation method of the majority of multi-agent reinforcement learning (MARL) algorithms called KnowSR which takes advantage of the differences in learning between agents. We employ the idea of knowledge distillation (KD) to share knowledge among agents to shorten the training phase. To empirically demonstrate the robustness and effectiveness of KnowSR, we performed extensive experiments on state-of-the-art MARL algorithms in collaborative and competitive scenarios. The results demonstrate that KnowSR outperforms recently reported methodologies, emphasizing the importance of the proposed knowledge sharing for MARL.

READ FULL TEXT

page 9

page 10

page 11

research
03/27/2021

KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning

Recently, deep Reinforcement Learning (RL) algorithms have achieved dram...
research
05/27/2020

Parameter Sharing is Surprisingly Useful for Multi-Agent Deep Reinforcement Learning

"Nonstationarity" is a fundamental problem in cooperative multi-agent re...
research
06/17/2023

Genes in Intelligent Agents

Training intelligent agents in Reinforcement Learning (RL) is much more ...
research
03/02/2023

Reinforced Labels: Multi-Agent Deep Reinforcement Learning for Point-feature Label Placement

Over the past few years, Reinforcement Learning combined with Deep Learn...
research
02/15/2021

Scaling Multi-Agent Reinforcement Learning with Selective Parameter Sharing

Sharing parameters in multi-agent deep reinforcement learning has played...
research
05/18/2023

Sharing Lifelong Reinforcement Learning Knowledge via Modulating Masks

Lifelong learning agents aim to learn multiple tasks sequentially over a...
research
04/08/2018

Hierarchical Modular Reinforcement Learning Method and Knowledge Acquisition of State-Action Rule for Multi-target Problem

Hierarchical Modular Reinforcement Learning (HMRL), consists of 2 layere...

Please sign up or login with your details

Forgot password? Click here to reset