Intelligent problem-solving as integrated hierarchical reinforcement learning

08/18/2022
by   Manfred Eppe, et al.
0

According to cognitive psychology and related disciplines, the development of complex problem-solving behaviour in biological agents depends on hierarchical cognitive mechanisms. Hierarchical reinforcement learning is a promising computational approach that may eventually yield comparable problem-solving behaviour in artificial agents and robots. However, to date the problem-solving abilities of many human and non-human animals are clearly superior to those of artificial systems. Here, we propose steps to integrate biologically inspired hierarchical mechanisms to enable advanced problem-solving skills in artificial agents. Therefore, we first review the literature in cognitive psychology to highlight the importance of compositional abstraction and predictive processing. Then we relate the gained insights with contemporary hierarchical reinforcement learning methods. Interestingly, our results suggest that all identified cognitive mechanisms have been implemented individually in isolated computational architectures, raising the question of why there exists no single unifying architecture that integrates them. As our final contribution, we address this question by providing an integrative perspective on the computational challenges to develop such a unifying architecture. We expect our results to guide the development of more sophisticated cognitively inspired hierarchical machine learning architectures.

READ FULL TEXT

page 1

page 2

page 4

research
12/18/2020

Hierarchical principles of embodied reinforcement learning: A review

Cognitive Psychology and related disciplines have identified several cri...
research
06/09/2015

Arguments for the Effectiveness of Human Problem Solving

The question of how humans solve problem has been addressed extensively....
research
08/01/2016

Discovering Latent States for Model Learning: Applying Sensorimotor Contingencies Theory and Predictive Processing to Model Context

Autonomous robots need to be able to adapt to unforeseen situations and ...
research
06/02/2022

Vygotskian Autotelic Artificial Intelligence: Language and Culture Internalization for Human-Like AI

Building autonomous artificial agents able to grow open-ended repertoire...
research
12/13/2017

Adaptation to criticality through organizational invariance in embodied agents

Many biological and cognitive systems do not operate deep within one or ...
research
02/01/2021

Interpretable Reinforcement Learning Inspired by Piaget's Theory of Cognitive Development

Endeavors for designing robots with human-level cognitive abilities have...
research
02/09/2023

What are the mechanisms underlying metacognitive learning?

How is it that humans can solve complex planning tasks so efficiently de...

Please sign up or login with your details

Forgot password? Click here to reset