Improved cooperation by balancing exploration and exploitation in intertemporal social dilemma tasks

10/19/2021
by   Zhenbo Cheng, et al.
0

When an individual's behavior has rational characteristics, this may lead to irrational collective actions for the group. A wide range of organisms from animals to humans often evolve the social attribute of cooperation to meet this challenge. Therefore, cooperation among individuals is of great significance for allowing social organisms to adapt to changes in the natural environment. Based on multi-agent reinforcement learning, we propose a new learning strategy for achieving coordination by incorporating a learning rate that can balance exploration and exploitation. We demonstrate that agents that use the simple strategy improve a relatively collective return in a decision task called the intertemporal social dilemma, where the conflict between the individual and the group is particularly sharp. We also explore the effects of the diversity of learning rates on the population of reinforcement learning agents and show that agents trained in heterogeneous populations develop particularly coordinated policies relative to those trained in homogeneous populations.

READ FULL TEXT
research
11/14/2018

Evolving intrinsic motivations for altruistic behavior

Multi-agent cooperation is an important feature of the natural world. Ma...
research
02/06/2020

Social Diversity and Social Preferences in Mixed-Motive Reinforcement Learning

Recent research on reinforcement learning in pure-conflict and pure-comm...
research
09/01/2022

Intrinsic fluctuations of reinforcement learning promote cooperation

In this work, we ask for and answer what makes classical reinforcement l...
research
01/30/2022

Learning Collective Action under Risk Diversity

Collective risk dilemmas (CRDs) are a class of n-player games that repre...
research
01/04/2023

Emergent collective intelligence from massive-agent cooperation and competition

Inspired by organisms evolving through cooperation and competition betwe...
research
02/20/2023

Co-evolution of Social and Non-Social Guilt

Building ethical machines may involve bestowing upon them the emotional ...
research
01/18/2022

Speed-vs-Accuracy Tradeoff in Collective Estimation: An Adaptive Exploration-Exploitation Case

The tradeoff between accuracy and speed is considered fundamental to ind...

Please sign up or login with your details

Forgot password? Click here to reset