Object and Relation Centric Representations for Push Effect Prediction

02/03/2021
by   Ahmet E. Tekden, et al.
0

Pushing is an essential non-prehensile manipulation skill used for tasks ranging from pre-grasp manipulation to scene rearrangement, reasoning about object relations in the scene, and thus pushing actions have been widely studied in robotics. The effective use of pushing actions often requires an understanding of the dynamics of the manipulated objects and adaptation to the discrepancies between prediction and reality. For this reason, effect prediction and parameter estimation with pushing actions have been heavily investigated in the literature. However, current approaches are limited because they either model systems with a fixed number of objects or use image-based representations whose outputs are not very interpretable and quickly accumulate errors. In this paper, we propose a graph neural network based framework for effect prediction and parameter estimation of pushing actions by modeling object relations based on contacts or articulations. Our framework is validated both in real and simulated environments containing different shaped multi-part objects connected via different types of joints and objects with different masses. Our approach enables the robot to predict and adapt the effect of a pushing action as it observes the scene. Further, we demonstrate 6D effect prediction in the lever-up action in the context of robot-based hard-disk disassembly.

READ FULL TEXT

page 1

page 4

page 9

page 10

research
09/24/2022

Planning for Multi-Object Manipulation with Graph Neural Network Relational Classifiers

Objects rarely sit in isolation in human environments. As such, we'd lik...
research
02/13/2023

Learning Tri-mode Grasping for Ambidextrous Robot Picking

Object picking in cluttered scenes is a widely investigated field of rob...
research
03/16/2023

Multi-step planning with learned effects of (possibly partial) action executions

In this paper, we propose an affordance model, which is built on Conditi...
research
10/24/2022

Abductive Action Inference

Abductive reasoning aims to make the most likely inference for a given s...
research
08/01/2022

Exploring the GLIDE model for Human Action-effect Prediction

We address the following action-effect prediction task. Given an image d...
research
09/09/2019

Belief Regulated Dual Propagation Nets for Learning Action Effects on Articulated Multi-Part Objects

In recent years, graph neural networks have been successfully applied fo...
research
08/01/2022

Learning Multi-Object Symbols for Manipulation with Attentive Deep Effect Predictors

In this paper, we propose a concept learning architecture that enables a...

Please sign up or login with your details

Forgot password? Click here to reset