Developmental Curiosity and Social Interaction in Virtual Agents

05/22/2023
by   Chris Doyle, et al.
0

Infants explore their complex physical and social environment in an organized way. To gain insight into what intrinsic motivations may help structure this exploration, we create a virtual infant agent and place it in a developmentally-inspired 3D environment with no external rewards. The environment has a virtual caregiver agent with the capability to interact contingently with the infant agent in ways that resemble play. We test intrinsic reward functions that are similar to motivations that have been proposed to drive exploration in humans: surprise, uncertainty, novelty, and learning progress. These generic reward functions lead the infant agent to explore its environment and discover the contingencies that are embedded into the caregiver agent. The reward functions that are proxies for novelty and uncertainty are the most successful in generating diverse experiences and activating the environment contingencies. We also find that learning a world model in the presence of an attentive caregiver helps the infant agent learn how to predict scenarios with challenging social and physical dynamics. Taken together, our findings provide insight into how curiosity-like intrinsic rewards and contingent social interaction lead to dynamic social behavior and the creation of a robust predictive world model.

READ FULL TEXT

page 1

page 4

page 5

research
10/29/2022

Curiosity-Driven Multi-Agent Exploration with Mixed Objectives

Intrinsic rewards have been increasingly used to mitigate the sparse rew...
research
11/14/2022

Redeeming Intrinsic Rewards via Constrained Optimization

State-of-the-art reinforcement learning (RL) algorithms typically use ra...
research
12/15/2019

How Should an Agent Practice?

We present a method for learning intrinsic reward functions to drive the...
research
06/16/2020

Learning About Objects by Learning to Interact with Them

Much of the remarkable progress in computer vision has been focused arou...
research
06/10/2018

Deep Curiosity Loops in Social Environments

Inspired by infants' intrinsic motivation to learn, which values informa...
research
11/18/2022

Curiosity in hindsight

Consider the exploration in sparse-reward or reward-free environments, s...
research
02/21/2018

Learning to Play with Intrinsically-Motivated Self-Aware Agents

Infants are experts at playing, with an amazing ability to generate nove...

Please sign up or login with your details

Forgot password? Click here to reset