Learning Spatial and Temporal Hierarchies: Hierarchical Active Inference for navigation in Multi-Room Maze Environments

09/18/2023
by   Daria de Tinguy, et al.
0

Cognitive maps play a crucial role in facilitating flexible behaviour by representing spatial and conceptual relationships within an environment. The ability to learn and infer the underlying structure of the environment is crucial for effective exploration and navigation. This paper introduces a hierarchical active inference model addressing the challenge of inferring structure in the world from pixel-based observations. We propose a three-layer hierarchical model consisting of a cognitive map, an allocentric, and an egocentric world model, combining curiosity-driven exploration with goal-oriented behaviour at the different levels of reasoning from context to place to motion. This allows for efficient exploration and goal-directed search in room-structured mini-grid environments.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 9

page 10

page 11

page 12

research
06/23/2023

Inferring Hierarchical Structure in Multi-Room Maze Environments

Cognitive maps play a crucial role in facilitating flexible behaviour by...
research
08/16/2023

Integrating cognitive map learning and active inference for planning in ambiguous environments

Living organisms need to acquire both cognitive maps for learning the st...
research
08/21/2020

Occupancy Anticipation for Efficient Exploration and Navigation

State-of-the-art navigation methods leverage a spatial memory to general...
research
10/23/2021

Map Induction: Compositional spatial submap learning for efficient exploration in novel environments

Humans are expert explorers. Understanding the computational cognitive m...
research
11/16/2018

On the Complexity of Exploration in Goal-Driven Navigation

Building agents that can explore their environments intelligently is a c...
research
03/07/2022

Robust Structure Identification and Room Segmentation of Cluttered Indoor Environments from Occupancy Grid Maps

Identifying the environment's structure, i.e., to detect core components...
research
08/19/2022

Home Run: Finding Your Way Home by Imagining Trajectories

When studying unconstrained behaviour and allowing mice to leave their c...

Please sign up or login with your details

Forgot password? Click here to reset