DefGraspSim: Physics-based simulation of grasp outcomes for 3D deformable objects

03/21/2022
by   Isabella Huang, et al.
0

Robotic grasping of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, developing grasp strategies for such objects is uniquely challenging. Unlike rigid objects, deformable objects have infinite degrees of freedom and require field quantities (e.g., deformation, stress) to fully define their state. As these quantities are not easily accessible in the real world, we propose studying interaction with deformable objects through physics-based simulation. As such, we simulate grasps on a wide range of 3D deformable objects using a GPU-based implementation of the corotational finite element method (FEM). To facilitate future research, we open-source our simulated dataset (34 objects, 1e5 Pa elasticity range, 6800 grasp evaluations, 1.1M grasp measurements), as well as a code repository that allows researchers to run our full FEM-based grasp evaluation pipeline on arbitrary 3D object models of their choice. Finally, we demonstrate good correspondence between grasp outcomes on simulated objects and their real counterparts.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
07/12/2021

DefGraspSim: Simulation-based grasping of 3D deformable objects

Robotic grasping of 3D deformable objects (e.g., fruits/vegetables, inte...
research
03/28/2023

DefGraspNets: Grasp Planning on 3D Fields with Graph Neural Nets

Robotic grasping of 3D deformable objects is critical for real-world app...
research
10/18/2022

Bag All You Need: Learning a Generalizable Bagging Strategy for Heterogeneous Objects

We introduce a practical robotics solution for the task of heterogeneous...
research
02/04/2022

Neural Collision Detection for Deformable Objects

We propose a neural network-based approach for collision detection with ...
research
07/19/2021

Towards synthesizing grasps for 3D deformable objects with physics-based simulation

Grasping deformable objects is not well researched due to the complexity...
research
09/11/2021

Deformation-Aware Data-Driven Grasp Synthesis

Grasp synthesis for 3D deformable objects remains a little-explored topi...
research
09/18/2023

Grasp-Anything: Large-scale Grasp Dataset from Foundation Models

Foundation models such as ChatGPT have made significant strides in robot...

Please sign up or login with your details

Forgot password? Click here to reset