Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Research

03/02/2019
by   Joel Z. Leibo, et al.
16

Evolution has produced a multi-scale mosaic of interacting adaptive units. Innovations arise when perturbations push parts of the system away from stable equilibria into new regimes where previously well-adapted solutions no longer work. Here we explore the hypothesis that multi-agent systems sometimes display intrinsic dynamics arising from competition and cooperation that provide a naturally emergent curriculum, which we term an autocurriculum. The solution of one social task often begets new social tasks, continually generating novel challenges, and thereby promoting innovation. Under certain conditions these challenges may become increasingly complex over time, demanding that agents accumulate ever more innovations.

READ FULL TEXT

page 1

page 2

page 5

page 8

research
05/19/2023

Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning

Social dilemmas are situations where groups of individuals can benefit f...
research
01/19/2023

Investigating the Impact of Direct Punishment on the Emergence of Cooperation in Multi-Agent Reinforcement Learning Systems

The problem of cooperation is of fundamental importance for human societ...
research
04/22/2014

A Formal Analysis of Required Cooperation in Multi-agent Planning

Research on multi-agent planning has been popular in recent years. While...
research
06/10/2020

The Emergence of Individuality in Multi-Agent Reinforcement Learning

Individuality is essential in human society, which induces the division ...
research
02/15/2023

TiZero: Mastering Multi-Agent Football with Curriculum Learning and Self-Play

Multi-agent football poses an unsolved challenge in AI research. Existin...
research
02/13/2021

Modelling Cooperation in Network Games with Spatio-Temporal Complexity

The real world is awash with multi-agent problems that require collectiv...
research
06/13/2022

Cumulative culture spontaneously emerges in artificial navigators who are social and memory-guided

While previously thought to be uniquely human, cumulative cultural evolu...

Please sign up or login with your details

Forgot password? Click here to reset