Solving Physics Puzzles by Reasoning about Paths

11/14/2020
by   Augustin Harter, et al.
0

We propose a new deep learning model for goal-driven tasks that require intuitive physical reasoning and intervention in the scene to achieve a desired end goal. Its modular structure is motivated by hypothesizing a sequence of intuitive steps that humans apply when trying to solve such a task. The model first predicts the path the target object would follow without intervention and the path the target object should follow in order to solve the task. Next, it predicts the desired path of the action object and generates the placement of the action object. All components of the model are trained jointly in a supervised way; each component receives its own learning signal but learning signals are also backpropagated through the entire architecture. To evaluate the model we use PHYRE - a benchmark test for goal-driven physical reasoning in 2D mechanics puzzles.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2020

Describing Physics For Physical Reasoning: Force-based Sequential Manipulation Planning

Physical reasoning is a core aspect of intelligence in animals and human...
research
12/28/2018

Reasoning About Physical Interactions with Object-Oriented Prediction and Planning

Object-based factorizations provide a useful level of abstraction for in...
research
04/19/2019

Learning Manipulation under Physics Constraints with Visual Perception

Understanding physical phenomena is a key competence that enables humans...
research
03/20/2018

IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoning

In order to reach human performance on complex visual tasks, artificial ...
research
08/15/2019

PHYRE: A New Benchmark for Physical Reasoning

Understanding and reasoning about physics is an important ability of int...
research
04/05/2019

Structured agents for physical construction

Physical construction -- the ability to compose objects, subject to phys...
research
02/20/2021

Physical Reasoning Using Dynamics-Aware Models

A common approach to solving physical-reasoning tasks is to train a valu...

Please sign up or login with your details

Forgot password? Click here to reset