How much data are needed to calibrate and test agent-based models?

11/20/2018
by   Vivek Srikrishnan, et al.
0

Agent-based models (ABMs) are widely used to gain insights into the dynamics of coupled natural human systems and to assess risk management strategies Choosing a sound model structure and parameters requires careful calibration. However, ABMs are often not calibrated in a formal statistical sense. One key reason for this lack of formal calibration is the potentially large data requirements for ABMs with path-dependence and nonlinear feedbacks. Using a perfect model experiment, we examine the impact of varying data record structures on (i) model calibration and (ii) the ability to distinguish a model with agent interactions from one without. We show how limited data sets may not constrain even a model with just four parameters. This finding raises doubts about many ABM's predictive abilities in the absence of informative priors. We also illustrate how spatially aggregate data can be insufficient to identify the correct model structure. This emphasises the need for carefully fusing independent lines of evidence, for example from judgment and decision making experiments to select sound and informative priors.

READ FULL TEXT

page 1

page 6

research
08/26/2020

Surrogate Assisted Methods for the Parameterisation of Agent-Based Models

Parameter calibration is a major challenge in agent-based modelling and ...
research
09/17/2022

ASIR: Robust Agent-based Representation Of SIR Model

Compartmental models (written as CM) and agent-based models (written as ...
research
03/26/2016

Data-Driven Dynamic Decision Models

This article outlines a method for automatically generating models of dy...
research
03/07/2022

Automatic Calibration Framework of Agent-Based Models for Dynamic and Heterogeneous Parameters

Agent-based models (ABMs) highlight the importance of simulation validat...
research
12/27/2017

Features of Agent-based Models

The design of agent-based models (ABMs) is often ad-hoc when it comes to...
research
12/12/2017

Machine Learning simulates Agent-Based Model

Running agent-based models (ABMs) is a burdensome computational task, sp...
research
02/10/2021

Automated and Distributed Statistical Analysis of Economic Agent-Based Models

We propose a novel approach to the statistical analysis of simulation mo...

Please sign up or login with your details

Forgot password? Click here to reset