Meta-control of social learning strategies

06/18/2021
by   Anil Yaman, et al.
0

Social learning, copying other's behavior without actual experience, offers a cost-effective means of knowledge acquisition. However, it raises the fundamental question of which individuals have reliable information: successful individuals versus the majority. The former and the latter are known respectively as success-based and conformist social learning strategies. We show here that while the success-based strategy fully exploits the benign environment of low uncertainly, it fails in uncertain environments. On the other hand, the conformist strategy can effectively mitigate this adverse effect. Based on these findings, we hypothesized that meta-control of individual and social learning strategies provides effective and sample-efficient learning in volatile and uncertain environments. Simulations on a set of environments with various levels of volatility and uncertainty confirmed our hypothesis. The results imply that meta-control of social learning affords agents the leverage to resolve environmental uncertainty with minimal exploration cost, by exploiting others' learning as an external knowledge base.

READ FULL TEXT

page 7

page 39

research
04/26/2022

Social learning spontaneously emerges by searching optimal heuristics with deep reinforcement learning

How have individuals of social animals in nature evolved to learn from e...
research
08/26/2020

Safe Model-Based Meta-Reinforcement Learning: A Sequential Exploration-Exploitation Framework

Safe deployment of autonomous robots in diverse environments requires ag...
research
03/27/2013

Using T-Norm Based Uncertainty Calculi in a Naval Situation Assessment Application

RUM (Reasoning with Uncertainty Module), is an integrated software tool ...
research
06/26/2023

Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception

Uncertainty in control and perception poses challenges for autonomous ve...
research
09/28/2021

Meta Reinforcement Learning Based Sensor Scanning in 3D Uncertain Environments for Heterogeneous Multi-Robot Systems

We study a novel problem that tackles learning based sensor scanning in ...
research
09/15/2021

Evolutionary Reinforcement Learning Dynamics with Irreducible Environmental Uncertainty

In this work we derive and present evolutionary reinforcement learning d...
research
10/09/2020

Learning not to learn: Nature versus nurture in silico

Animals are equipped with a rich innate repertoire of sensory, behaviora...

Please sign up or login with your details

Forgot password? Click here to reset