Intrinsic Motivation Driven Intuitive Physics Learning using Deep Reinforcement Learning with Intrinsic Reward Normalization

07/06/2019
by   JaeWon Choi, et al.
0

At an early age, human infants are able to learn and build a model of the world very quickly by constantly observing and interacting with objects around them. One of the most fundamental intuitions human infants acquire is intuitive physics. Human infants learn and develop these models, which later serve as prior knowledge for further learning. Inspired by such behaviors exhibited by human infants, we introduce a graphical physics network integrated with deep reinforcement learning. Specifically, we introduce an intrinsic reward normalization method that allows our agent to efficiently choose actions that can improve its intuitive physics model the most. Using a 3D physics engine, we show that our graphical physics network is able to infer object's positions and velocities very effectively, and our deep reinforcement learning network encourages an agent to improve its model by making it continuously interact with objects only using intrinsic motivation. We experiment our model in both stationary and non-stationary state problems and show benefits of our approach in terms of the number of different actions the agent performs and the accuracy of agent's intuition model. Videos are at https://www.youtube.com/watch?v=pDbByp91r3M&t=2s

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2023

Curiosity-driven Exploration in Sparse-reward Multi-agent Reinforcement Learning

Sparsity of rewards while applying a deep reinforcement learning method ...
research
07/07/2020

Deep Reinforcement Learning with Interactive Feedback in a Human-Robot Environment

Robots are extending their presence in domestic environments every day, ...
research
01/24/2023

Intrinsic Motivation in Model-based Reinforcement Learning: A Brief Review

The reinforcement learning research area contains a wide range of method...
research
02/21/2018

Emergence of Structured Behaviors from Curiosity-Based Intrinsic Motivation

Infants are experts at playing, with an amazing ability to generate nove...
research
05/22/2023

Measuring and Modeling Physical Intrinsic Motivation

Humans are interactive agents driven to seek out situations with interes...
research
11/14/2020

Towards Human-Level Learning of Complex Physical Puzzles

Humans quickly solve tasks in novel systems with complex dynamics, witho...
research
06/26/2022

Learning to Rearrange with Physics-Inspired Risk Awareness

Real-world applications require a robot operating in the physical world ...

Please sign up or login with your details

Forgot password? Click here to reset