Bayesian policy selection using active inference

04/17/2019
by   Ozan Çatal, et al.
0

Learning to take actions based on observations is a core requirement for artificial agents to be able to be successful and robust at their task. Reinforcement Learn-ing (RL) is a well-known technique for learning such policies. However, current RL algorithms often have to deal with reward shaping, have difficulties generalizing to other environments and are most often sample inefficient. In this paper, we explore active inference and the free energy principle, a normative theory from neuroscience that explains how self-organizing biological systems operate by maintaining a model of the world and casting action selection as an inference problem. We apply this concept to a typical problem known to the RL community, the mountain car problem, and show how active inference encompasses both RL and learning from demonstrations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2019

Scaling active inference

In reinforcement learning (RL), agents often operate in partially observ...
research
06/21/2018

Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop

Active inference is an ambitious theory that treats perception, inferenc...
research
01/22/2021

Prior Preference Learning from Experts:Designing a Reward with Active Inference

Active inference may be defined as Bayesian modeling of a brain with a b...
research
04/24/2020

The Two Kinds of Free Energy and the Bayesian Revolution

The concept of free energy has its origins in 19th century thermodynamic...
research
09/06/2022

Efficient search of active inference policy spaces using k-means

We develop an approach to policy selection in active inference that allo...
research
03/13/2015

A Minimal Active Inference Agent

Research on the so-called "free-energy principle" (FEP) in cognitive neu...
research
06/07/2020

Deep active inference agents using Monte-Carlo methods

Active inference is a Bayesian framework for understanding biological in...

Please sign up or login with your details

Forgot password? Click here to reset