Inequity aversion resolves intertemporal social dilemmas

03/23/2018
by   Edward Hughes, et al.
0

Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to explain this phenomenon for unrealistic stateless matrix games. Recently, multi-agent reinforcement learning has been applied to generalize social dilemma problems to temporally and spatially extended Markov games. However, this has not yet generated an agent that learns to cooperate in social dilemmas as humans do. A key insight is that many, but not all, human individuals have inequity averse social preferences. This promotes a particular resolution of the matrix game social dilemma wherein inequity-averse individuals are personally pro-social and punish defectors. Here we extend this idea to Markov games and show that it promotes cooperation in several types of sequential social dilemma, via a profitable interaction with policy learnability. In particular, we find that inequity aversion improves temporal credit assignment for the important class of intertemporal social dilemmas. These results help explain how large-scale cooperation may emerge and persist.

READ FULL TEXT

page 2

page 8

research
03/23/2018

Inequity aversion improves cooperation in intertemporal social dilemmas

Groups of humans are often able to find ways to cooperate with one anoth...
research
02/10/2017

Multi-agent Reinforcement Learning in Sequential Social Dilemmas

Matrix games like Prisoner's Dilemma have guided research on social dile...
research
03/01/2018

Towards Cooperation in Sequential Prisoner's Dilemmas: a Deep Multiagent Reinforcement Learning Approach

The Iterated Prisoner's Dilemma has guided research on social dilemmas f...
research
02/26/2020

Leaving bads provides better outcome than approaching goods in a social dilemma

Individual migration has been regarded as an important factor for the ev...
research
01/26/2021

Data sharing games

Data sharing issues pervade online social and economic environments. To ...
research
07/23/2018

Individual perception dynamics in drunk games

We study the effects of individual perceptions of payoffs in two-player ...
research
06/15/2022

From Outcome-Based to Language-Based Preferences

We review the literature on models that try to explain human behavior in...

Please sign up or login with your details

Forgot password? Click here to reset