Thermodynamically rational decision making under uncertainty

09/19/2023
by   Dorian Daimer, et al.
0

Inference principles are postulated within statistics, they are not usually derived from any underlying physical constraints on real world observers. An exception to this rule is that in the context of partially observable information engines decision making can be based solely on physical arguments. An inference principle can be derived from minimization of the lower bound on average dissipation [Phys. Rev. Lett., 124(5), 050601], which is achievable with a quasi-static process. Thermodynamically rational decision strategies can be computed algorithmically with the resulting approach. Here, we use this to study an example of binary decision making under uncertainty that is very simple, yet just interesting enough to be non-trivial: observations are either entirely uninformative, or they carry complete certainty about the variable that needs to be known for successful energy harvesting. Solutions found algorithmically can be expressed in terms of parameterized soft partitions of the observable space. This allows for their interpretation, as well as for the analytical calculation of all quantities that characterize the decision problem and the thermodynamically rational strategies.

READ FULL TEXT
research
03/13/2013

Decision Making Using Probabilistic Inference Methods

The analysis of decision making under uncertainty is closely related to ...
research
02/13/2019

Relative rationality: Is machine rationality subjective?

Rational decision making in its linguistic description means making logi...
research
12/27/2009

A Rational Decision Maker with Ordinal Utility under Uncertainty: Optimism and Pessimism

In game theory and artificial intelligence, decision making models often...
research
02/20/2021

On a notion of independence proposed by Teddy Seidenfeld

Teddy Seidenfeld has been arguing for quite a long time that binary pref...
research
11/05/2015

Adaptive information-theoretic bounded rational decision-making with parametric priors

Deviations from rational decision-making due to limited computational re...
research
05/17/2012

Free Energy and the Generalized Optimality Equations for Sequential Decision Making

The free energy functional has recently been proposed as a variational p...
research
05/22/2020

microPhantom: Playing microRTS under uncertainty and chaos

This competition paper presents microPhantom, a bot playing to microRTS ...

Please sign up or login with your details

Forgot password? Click here to reset