DeepAI AI Chat
Log In Sign Up

Have I done enough planning or should I plan more?

01/03/2022
by   Ruiqi He, et al.
Max Planck Society
0

People's decisions about how to allocate their limited computational resources are essential to human intelligence. An important component of this metacognitive ability is deciding whether to continue thinking about what to do and move on to the next decision. Here, we show that people acquire this ability through learning and reverse-engineer the underlying learning mechanisms. Using a process-tracing paradigm that externalises human planning, we find that people quickly adapt how much planning they perform to the cost and benefit of planning. To discover the underlying metacognitive learning mechanisms we augmented a set of reinforcement learning models with metacognitive features and performed Bayesian model selection. Our results suggest that the metacognitive ability to adjust the amount of planning might be learned through a policy-gradient mechanism that is guided by metacognitive pseudo-rewards that communicate the value of planning.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/09/2023

What are the mechanisms underlying metacognitive learning?

How is it that humans can solve complex planning tasks so efficiently de...
01/31/2021

Improving Human Decision-Making by Discovering Efficient Strategies for Hierarchical Planning

To make good decisions in the real world people need efficient planning ...
02/13/2020

The Efficiency of Human Cognition Reflects Planned Information Processing

Planning is useful. It lets people take actions that have desirable long...
05/14/2021

Control of mental representations in human planning

One of the most striking features of human cognition is the capacity to ...
01/24/2023

Minimal Value-Equivalent Partial Models for Scalable and Robust Planning in Lifelong Reinforcement Learning

Learning models of the environment from pure interaction is often consid...
05/15/2020

Think Too Fast Nor Too Slow: The Computational Trade-off Between Planning And Reinforcement Learning

Planning and reinforcement learning are two key approaches to sequential...
09/27/2017

The detour problem in a stochastic environment: Tolman revisited

We designed a grid world task to study human planning and re-planning be...