Learning Complex Spatial Behaviours in ABM: An Experimental Observational Study

01/04/2022
by   Sedar Olmez, et al.
1

Capturing and simulating intelligent adaptive behaviours within spatially explicit individual-based models remains an ongoing challenge for researchers. While an ever-increasing abundance of real-world behavioural data are collected, few approaches exist that can quantify and formalise key individual behaviours and how they change over space and time. Consequently, commonly used agent decision-making frameworks, such as event-condition-action rules, are often required to focus only on a narrow range of behaviours. We argue that these behavioural frameworks often do not reflect real-world scenarios and fail to capture how behaviours can develop in response to stimuli. There has been an increased interest in Machine Learning methods and their potential to simulate intelligent adaptive behaviours in recent years. One method that is beginning to gain traction in this area is Reinforcement Learning (RL). This paper explores how RL can be applied to create emergent agent behaviours using a simple predator-prey Agent-Based Model (ABM). Running a series of simulations, we demonstrate that agents trained using the novel Proximal Policy Optimisation (PPO) algorithm behave in ways that exhibit properties of real-world intelligent adaptive behaviours, such as hiding, evading and foraging.

READ FULL TEXT

page 7

page 8

page 15

page 17

page 18

page 19

page 22

page 23

research
06/20/2017

Observational Learning by Reinforcement Learning

Observational learning is a type of learning that occurs as a function o...
research
06/09/2020

Policy-focused Agent-based Modeling using RL Behavioral Models

Agent-based Models (ABMs) are valuable tools for policy analysis. ABMs h...
research
09/18/2019

Segregation Dynamics with Reinforcement Learning and Agent Based Modeling

Societies are complex. Properties of social systems can be explained by ...
research
01/12/2023

Blind Judgement: Agent-Based Supreme Court Modelling With GPT

We present a novel Transformer-based multi-agent system for simulating t...
research
11/08/2021

A Bayesian Analysis of Migration Pathways using Chain Event Graphs of Agent Based Models

Agent-Based Models (ABMs) are often used to model migration and are incr...
research
02/14/2022

Automatic Generation of Individual Fuzzy Cognitive Maps from Longitudinal Data

Fuzzy Cognitive Maps (FCMs) are computational models that represent how ...
research
10/20/2022

Co-Training an Observer and an Evading Target

Reinforcement learning (RL) is already widely applied to applications su...

Please sign up or login with your details

Forgot password? Click here to reset