Curiosity-driven Exploration in Sparse-reward Multi-agent Reinforcement Learning

02/21/2023
by   Jiong Li, et al.
0

Sparsity of rewards while applying a deep reinforcement learning method negatively affects its sample-efficiency. A viable solution to deal with the sparsity of rewards is to learn via intrinsic motivation which advocates for adding an intrinsic reward to the reward function to encourage the agent to explore the environment and expand the sample space. Though intrinsic motivation methods are widely used to improve data-efficient learning in the reinforcement learning model, they also suffer from the so-called detachment problem. In this article, we discuss the limitations of intrinsic curiosity module in sparse-reward multi-agent reinforcement learning and propose a method called I-Go-Explore that combines the intrinsic curiosity module with the Go-Explore framework to alleviate the detachment problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/29/2022

Curiosity-Driven Multi-Agent Exploration with Mixed Objectives

Intrinsic rewards have been increasingly used to mitigate the sparse rew...
research
08/25/2023

Go Beyond Imagination: Maximizing Episodic Reachability with World Models

Efficient exploration is a challenging topic in reinforcement learning, ...
research
02/19/2023

AIIR-MIX: Multi-Agent Reinforcement Learning Meets Attention Individual Intrinsic Reward Mixing Network

Deducing the contribution of each agent and assigning the corresponding ...
research
05/25/2018

Visceral Machines: Reinforcement Learning with Intrinsic Rewards that Mimic the Human Nervous System

The human autonomic nervous system has evolved over millions of years an...
research
05/18/2017

Feature Control as Intrinsic Motivation for Hierarchical Reinforcement Learning

The problem of sparse rewards is one of the hardest challenges in contem...
research
01/24/2023

Intrinsic Motivation in Model-based Reinforcement Learning: A Brief Review

The reinforcement learning research area contains a wide range of method...
research
07/06/2019

Intrinsic Motivation Driven Intuitive Physics Learning using Deep Reinforcement Learning with Intrinsic Reward Normalization

At an early age, human infants are able to learn and build a model of th...

Please sign up or login with your details

Forgot password? Click here to reset