Predicting the Physical Dynamics of Unseen 3D Objects

01/16/2020
by   Davis Rempe, et al.
19

Machines that can predict the effect of physical interactions on the dynamics of previously unseen object instances are important for creating better robots and interactive virtual worlds. In this work, we focus on predicting the dynamics of 3D objects on a plane that have just been subjected to an impulsive force. In particular, we predict the changes in state - 3D position, rotation, velocities, and stability. Different from previous work, our approach can generalize dynamics predictions to object shapes and initial conditions that were unseen during training. Our method takes the 3D object's shape as a point cloud and its initial linear and angular velocities as input. We extract shape features and use a recurrent neural network to predict the full change in state at each time step. Our model can support training with data from both a physics engine or the real world. Experiments show that we can accurately predict the changes in state for unseen object geometries and initial conditions.

READ FULL TEXT

page 3

page 5

page 8

research
01/02/2019

Learning Generalizable Physical Dynamics of 3D Rigid Objects

Humans have a remarkable ability to predict the effect of physical inter...
research
12/01/2016

A Compositional Object-Based Approach to Learning Physical Dynamics

We present the Neural Physics Engine (NPE), a framework for learning sim...
research
02/21/2023

Sim2Real^2: Actively Building Explicit Physics Model for Precise Articulated Object Manipulation

Accurately manipulating articulated objects is a challenging yet importa...
research
05/09/2022

FlowBot3D: Learning 3D Articulation Flow to Manipulate Articulated Objects

We explore a novel method to perceive and manipulate 3D articulated obje...
research
10/11/2017

Combining learned and analytical models for predicting action effects

One of the most basic skills a robot should possess is predicting the ef...
research
10/13/2016

Predicting the dynamics of 2d objects with a deep residual network

We investigate how a residual network can learn to predict the dynamics ...
research
08/29/2018

Interpretable Intuitive Physics Model

Humans have a remarkable ability to use physical commonsense and predict...

Please sign up or login with your details

Forgot password? Click here to reset