Realising Active Inference in Variational Message Passing: the Outcome-blind Certainty Seeker

04/23/2021
by   Théophile Champion, et al.
0

Active inference is a state-of-the-art framework in neuroscience that offers a unified theory of brain function. It is also proposed as a framework for planning in AI. Unfortunately, the complex mathematics required to create new models – can impede application of active inference in neuroscience and AI research. This paper addresses this problem by providing a complete mathematical treatment of the active inference framework – in discrete time and state spaces – and the derivation of the update equations for any new model. We leverage the theoretical connection between active inference and variational message passing as describe by John Winn and Christopher M. Bishop in 2005. Since, variational message passing is a well-defined methodology for deriving Bayesian belief update equations, this paper opens the door to advanced generative models for active inference. We show that using a fully factorized variational distribution simplifies the expected free energy – that furnishes priors over policies – so that agents seek unambiguous states. Finally, we consider future extensions that support deep tree searches for sequential policy optimisation – based upon structure learning and belief propagation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2023

Realising Synthetic Active Inference Agents, Part II: Variational Message Updates

The Free Energy Principle (FEP) describes (biological) agents as minimis...
research
12/25/2021

Reactive Message Passing for Scalable Bayesian Inference

We introduce Reactive Message Passing (RMP) as a framework for executing...
research
12/02/2022

Designing Ecosystems of Intelligence from First Principles

This white paper lays out a vision of research and development in the fi...
research
12/14/2021

Branching Time Active Inference with Bayesian Filtering

Branching Time Active Inference (Champion et al., 2021b,a) is a framewor...
research
11/22/2021

Branching Time Active Inference: empirical study and complexity class analysis

Active inference is a state-of-the-art framework for modelling the brain...
research
06/13/2023

Realising Synthetic Active Inference Agents, Part I: Epistemic Objectives and Graphical Specification Language

The Free Energy Principle (FEP) is a theoretical framework for describin...
research
09/01/2021

Active Inference and Epistemic Value in Graphical Models

The Free Energy Principle (FEP) postulates that biological agents percei...

Please sign up or login with your details

Forgot password? Click here to reset