Bounded Rational Decision-Making in Changing Environments

12/24/2013
by   Jordi Grau-Moya, et al.
0

A perfectly rational decision-maker chooses the best action with the highest utility gain from a set of possible actions. The optimality principles that describe such decision processes do not take into account the computational costs of finding the optimal action. Bounded rational decision-making addresses this problem by specifically trading off information-processing costs and expected utility. Interestingly, a similar trade-off between energy and entropy arises when describing changes in thermodynamic systems. This similarity has been recently used to describe bounded rational agents. Crucially, this framework assumes that the environment does not change while the decision-maker is computing the optimal policy. When this requirement is not fulfilled, the decision-maker will suffer inefficiencies in utility, that arise because the current policy is optimal for an environment in the past. Here we borrow concepts from non-equilibrium thermodynamics to quantify these inefficiencies and illustrate with simulations its relationship with computational resources.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2011

Information, Utility & Bounded Rationality

Perfectly rational decision-makers maximize expected utility, but crucia...
research
10/22/2017

Hierarchical State Abstractions for Decision-Making Problems with Computational Constraints

In this semi-tutorial paper, we first review the information-theoretic a...
research
11/01/2019

Probabilistic Formulation of the Take The Best Heuristic

The framework of cognitively bounded rationality treats problem solving ...
research
05/17/2012

Free Energy and the Generalized Optimality Equations for Sequential Decision Making

The free energy functional has recently been proposed as a variational p...
research
11/21/2021

Consequences of Optimality

Rationality is often related to optimal decision making. Humans are know...
research
11/05/2015

Adaptive information-theoretic bounded rational decision-making with parametric priors

Deviations from rational decision-making due to limited computational re...
research
10/06/2016

Human Decision-Making under Limited Time

Subjective expected utility theory assumes that decision-makers possess ...

Please sign up or login with your details

Forgot password? Click here to reset