Deep Active Inference for Partially Observable MDPs

09/08/2020
by   Otto van der Himst, et al.
0

Deep active inference has been proposed as a scalable approach to perception and action that deals with large policy and state spaces. However, current models are limited to fully observable domains. In this paper, we describe a deep active inference model that can learn successful policies directly from high-dimensional sensory inputs. The deep learning architecture optimizes a variant of the expected free energy and encodes the continuous state representation by means of a variational autoencoder. We show, in the OpenAI benchmark, that our approach has comparable or better performance than deep Q-learning, a state-of-the-art deep reinforcement learning algorithm.

READ FULL TEXT

page 8

page 10

research
01/30/2020

Learning Perception and Planning with Deep Active Inference

Active inference is a process theory of the brain that states that all l...
research
07/08/2019

Deep Active Inference as Variational Policy Gradients

Active Inference is a theory of action arising from neuroscience which c...
research
09/09/2021

Deep Active Inference for Pixel-Based Discrete Control: Evaluation on the Car Racing Problem

Despite the potential of active inference for visual-based control, lear...
research
08/17/2020

A deep active inference model of the rubber-hand illusion

Understanding how perception and action deal with sensorimotor conflicts...
research
09/06/2022

Efficient search of active inference policy spaces using k-means

We develop an approach to policy selection in active inference that allo...
research
03/04/2019

Optimizing Object-based Perception and Control by Free-Energy Principle

One of the well-known formulations of human perception is a hierarchical...
research
10/02/2018

The Dreaming Variational Autoencoder for Reinforcement Learning Environments

Reinforcement learning has shown great potential in generalizing over ra...

Please sign up or login with your details

Forgot password? Click here to reset