Active inference, Bayesian optimal design, and expected utility

by   Noor Sajid, et al.

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how active inference combines Bayesian decision theory and optimal Bayesian design principles under a single imperative to minimize expected free energy. It is this aspect of active inference that allows for the natural emergence of information-seeking behavior. When removing prior outcomes preferences from expected free energy, active inference reduces to optimal Bayesian design, i.e., information gain maximization. Conversely, active inference reduces to Bayesian decision theory in the absence of ambiguity and relative risk, i.e., expected utility maximization. Using these limiting cases, we illustrate how behaviors differ when agents select actions that optimize expected utility, expected information gain, and expected free energy. Our T-maze simulations show optimizing expected free energy produces goal-directed information-seeking behavior while optimizing expected utility induces purely exploitive behavior and maximizing information gain engenders intrinsically motivated behavior.



There are no comments yet.



The relationship between dynamic programming and active inference: the discrete, finite-horizon case

Active inference is a normative framework for generating behaviour based...

Sophisticated Inference

Active inference offers a first principle account of sentient behaviour,...

Whence the Expected Free Energy?

The Expected Free Energy (EFE) is a central quantity in the theory of ac...

Learning Perception and Planning with Deep Active Inference

Active inference is a process theory of the brain that states that all l...

Inference of Affordances and Active Motor Control in Simulated Agents

Flexible, goal-directed behavior is a fundamental aspect of human life. ...

A Rate-Distortion view of human pragmatic reasoning

What computational principles underlie human pragmatic reasoning? A prom...

Active Inference and Epistemic Value in Graphical Models

The Free Energy Principle (FEP) postulates that biological agents percei...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.