SE3-Nets: Learning Rigid Body Motion using Deep Neural Networks

06/08/2016
by   Arunkumar Byravan, et al.
0

We introduce SE3-Nets, which are deep neural networks designed to model and learn rigid body motion from raw point cloud data. Based only on sequences of depth images along with action vectors and point wise data associations, SE3-Nets learn to segment effected object parts and predict their motion resulting from the applied force. Rather than learning point wise flow vectors, SE3-Nets predict SE3 transformations for different parts of the scene. Using simulated depth data of a table top scene and a robot manipulator, we show that the structure underlying SE3-Nets enables them to generate a far more consistent prediction of object motion than traditional flow based networks. Additional experiments with a depth camera observing a Baxter robot pushing objects on a table show that SE3-Nets also work well on real data.

READ FULL TEXT

page 5

page 7

page 8

research
10/02/2017

SE3-Pose-Nets: Structured Deep Dynamics Models for Visuomotor Planning and Control

In this work, we present an approach to deep visuomotor control using st...
research
10/30/2019

Motion-Nets: 6D Tracking of Unknown Objects in Unseen Environments using RGB

In this work, we bridge the gap between recent pose estimation and track...
research
06/06/2018

PointFlowNet: Learning Representations for 3D Scene Flow Estimation from Point Clouds

Despite significant progress in image-based 3D scene flow estimation, th...
research
08/12/2021

Distributional Depth-Based Estimation of Object Articulation Models

We propose a method that efficiently learns distributions over articulat...
research
05/09/2021

Simulated Data Generation Through Algorithmic Force Coefficient Estimation for AI-Based Robotic Projectile Launch Modeling

Modeling of non-rigid object launching and manipulation is complex consi...
research
03/14/2022

Extracting associations and meanings of objects depicted in artworks through bi-modal deep networks

We present a novel bi-modal system based on deep networks to address the...
research
05/28/2023

Forecasting the levels of disability in the older population of England: Application of neural nets

Deep neural networks are powerful tools for modelling non-linear pattern...

Please sign up or login with your details

Forgot password? Click here to reset