Learning Physical Intuition of Block Towers by Example

03/03/2016
by   Adam Lerer, et al.
0

Wooden blocks are a common toy for infants, allowing them to develop motor skills and gain intuition about the physical behavior of the world. In this paper, we explore the ability of deep feed-forward models to learn such intuitive physics. Using a 3D game engine, we create small towers of wooden blocks whose stability is randomized and render them collapsing (or remaining upright). This data allows us to train large convolutional network models which can accurately predict the outcome, as well as estimating the block trajectories. The models are also able to generalize in two important ways: (i) to new physical scenarios, e.g. towers with an additional block and (ii) to images of real wooden blocks, where it obtains a performance comparable to human subjects.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 8

research
12/12/2016

Generalizable Features From Unsupervised Learning

Humans learn a predictive model of the world and use this model to reaso...
research
04/21/2018

ShapeStacks: Learning Vision-Based Physical Intuition for Generalised Object Stacking

Physical intuition is pivotal for intelligent agents to perform complex ...
research
11/01/2017

Acquiring Target Stacking Skills by Goal-Parameterized Deep Reinforcement Learning

Understanding physical phenomena is a key component of human intelligenc...
research
06/08/2020

PSPACE-completeness of Pulling Blocks to Reach a Goal

We prove PSPACE-completeness of all but one problem in a large space of ...
research
02/21/2023

On the Behaviour of Pulsed Qubits and their Application to Feed Forward Networks

In the last two decades, the combination of machine learning and quantum...
research
05/11/2019

Explaining intuitive difficulty judgments by modeling physical effort and risk

The ability to estimate task difficulty is critical for many real-world ...

Please sign up or login with your details

Forgot password? Click here to reset