Learning Generalizable Physical Dynamics of 3D Rigid Objects

01/02/2019
by   Davis Rempe, et al.
17

Humans have a remarkable ability to predict the effect of physical interactions on the dynamics of objects. Endowing machines with this ability would allow important applications in areas like robotics and autonomous vehicles. In this work, we focus on predicting the dynamics of 3D rigid objects, in particular an object's final resting position and total rotation when subjected to an impulsive force. Different from previous work, our approach is capable of generalizing to unseen object shapes - an important requirement for real-world applications. To achieve this, we represent object shape as a 3D point cloud that is used as input to a neural network, making our approach agnostic to appearance variation. The design of our network is informed by an understanding of physical laws. We train our model with data from a physics engine that simulates the dynamics of a large number of shapes. Experiments show that we can accurately predict the resting position and total rotation for unseen object geometries.

READ FULL TEXT

page 3

page 4

page 5

page 8

page 11

page 12

page 13

research
01/16/2020

Predicting the Physical Dynamics of Unseen 3D Objects

Machines that can predict the effect of physical interactions on the dyn...
research
08/29/2018

Interpretable Intuitive Physics Model

Humans have a remarkable ability to use physical commonsense and predict...
research
06/21/2018

Flexible Neural Representation for Physics Prediction

Humans have a remarkable capacity to understand the physical dynamics of...
research
11/29/2018

Perceiving Physical Equation by Observing Visual Scenarios

Inferring universal laws of the environment is an important ability of h...
research
11/30/2021

DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapes

Differentiable physics is a powerful tool in computer vision and robotic...
research
04/25/2018

3D-PhysNet: Learning the Intuitive Physics of Non-Rigid Object Deformations

The ability to interact and understand the environment is a fundamental ...
research
02/20/2021

Physical Reasoning Using Dynamics-Aware Models

A common approach to solving physical-reasoning tasks is to train a valu...

Please sign up or login with your details

Forgot password? Click here to reset