Deformation-Aware Data-Driven Grasp Synthesis

09/11/2021
by   Tran Nguyen Le, et al.
0

Grasp synthesis for 3D deformable objects remains a little-explored topic, most works aiming to minimize deformations. However, deformations are not necessarily harmful – humans are, for example, able to exploit deformations to generate new potential grasps. How to achieve that on a robot is though an open question. This paper proposes an approach that uses object stiffness information in addition to depth images for synthesizing high-quality grasps. We achieve this by incorporating object stiffness as an additional input to a state-of-the-art deep grasp planning network. We also curate a new synthetic dataset of grasps on objects of varying stiffness using the Isaac Gym simulator for training the network. We experimentally validate and compare our proposed approach against the case where we do not incorporate object stiffness on a total of 2800 grasps in simulation and 420 grasps on a real Franka Emika Panda. The experimental results show significant improvement in grasp success rate using the proposed approach on a wide range of objects with varying shapes, sizes, and stiffness. Furthermore, we demonstrate that the approach can generate different grasping strategies for different stiffness values, such as pinching for soft objects and caging for hard objects. Together, the results clearly show the value of incorporating stiffness information when grasping objects of varying stiffness.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

research
03/23/2022

A Novel Simulation-Based Quality Metric for Evaluating Grasps on 3D Deformable Objects

Evaluation of grasps on deformable 3D objects is a little-studied proble...
research
07/19/2021

Towards synthesizing grasps for 3D deformable objects with physics-based simulation

Grasping deformable objects is not well researched due to the complexity...
research
07/12/2021

DefGraspSim: Simulation-based grasping of 3D deformable objects

Robotic grasping of 3D deformable objects (e.g., fruits/vegetables, inte...
research
06/19/2022

Learning Grasp Ability Enhancement through Deep Shape Generation

Data-driven especially deep learning-based approaches have become a domi...
research
12/17/2020

Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Grasps

While there exists a large number of methods for manipulating rigid obje...
research
03/21/2022

DefGraspSim: Physics-based simulation of grasp outcomes for 3D deformable objects

Robotic grasping of 3D deformable objects (e.g., fruits/vegetables, inte...
research
04/23/2021

Grasp Synthesis for Novel Objects Using Heuristic-based and Data-driven Active Vision Methods

In this work, we present several heuristic-based and data-driven active ...

Please sign up or login with your details

Forgot password? Click here to reset