Systems of bounded rational agents with information-theoretic constraints

09/16/2018
by   Sebastian Gottwald, et al.
0

Specialization and hierarchical organization are important features of efficient collaboration in economical, artificial, and biological systems. Here, we investigate the hypothesis that both features can be explained by the fact that each entity of such a system is limited in a certain way. We propose an information-theoretic approach based on a Free Energy principle, in order to computationally analyze systems of bounded rational agents that deal with such limitations optimally. We find that specialization allows to focus on fewer tasks, thus leading to a more efficient execution, but in turn requires coordination in hierarchical structures of specialized experts and coordinating units. Our results suggest that hierarchical architectures of specialized units at lower levels that are coordinated by units at higher levels are optimal, given that each unit's information-processing capability is limited and conforms to constraints on complexity costs.

READ FULL TEXT

page 18

page 21

page 23

research
07/26/2019

An Information-theoretic On-line Learning Principle for Specialization in Hierarchical Decision-Making Systems

Information-theoretic bounded rationality describes utility-optimizing d...
research
09/04/2018

Bounded Rational Decision-Making with Adaptive Neural Network Priors

Bounded rationality investigates utility-optimizing decision-makers with...
research
02/26/2016

Bounded Rational Decision-Making in Feedforward Neural Networks

Bounded rational decision-makers transform sensory input into motor outp...
research
12/21/2015

Information-Theoretic Bounded Rationality

Bounded rationality, that is, decision-making and planning under resourc...
research
10/30/2022

On Rate-Distortion Theory in Capacity-Limited Cognition Reinforcement Learning

Throughout the cognitive-science literature, there is widespread agreeme...
research
06/30/2021

Bounded rationality for relaxing best response and mutual consistency: An information-theoretic model of partial self-reference

While game theory has been transformative for decision-making, the assum...
research
12/01/2014

Understanding confounding effects in linguistic coordination: an information-theoretic approach

We suggest an information-theoretic approach for measuring stylistic coo...

Please sign up or login with your details

Forgot password? Click here to reset