Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmark

05/25/2023
by   Juncheng Li, et al.
0

This paper presents Sim-Suction, a robust object-aware suction grasp policy for mobile manipulation platforms with dynamic camera viewpoints, designed to pick up unknown objects from cluttered environments. Suction grasp policies typically employ data-driven approaches, necessitating large-scale, accurately-annotated suction grasp datasets. However, the generation of suction grasp datasets in cluttered environments remains underexplored, leaving uncertainties about the relationship between the object of interest and its surroundings. To address this, we propose a benchmark synthetic dataset, Sim-Suction-Dataset, comprising 500 cluttered environments with 3.2 million annotated suction grasp poses. The efficient Sim-Suction-Dataset generation process provides novel insights by combining analytical models with dynamic physical simulations to create fast and accurate suction grasp pose annotations. We introduce Sim-Suction-Pointnet to generate robust 6D suction grasp poses by learning point-wise affordances from the Sim-Suction-Dataset, leveraging the synergy of zero-shot text-to-segmentation. Real-world experiments for picking up all objects demonstrate that Sim-Suction-Pointnet achieves success rates of 96.76 objects (prismatic shape), cluttered level 2 objects (more complex geometry), and cluttered mixed objects, respectively. The Sim-Suction policies outperform state-of-the-art benchmarks tested by approximately 21 scenes.

READ FULL TEXT

page 1

page 5

page 7

page 8

page 10

page 11

page 13

page 14

research
11/11/2020

Accelerating Grasp Exploration by Leveraging Learned Priors

The ability of robots to grasp novel objects has industry applications i...
research
05/17/2023

Sim-MEES: Modular End-Effector System Grasping Dataset for Mobile Manipulators in Cluttered Environments

In this paper, we present Sim-MEES: a large-scale synthetic dataset that...
research
09/18/2023

Grasp-Anything: Large-scale Grasp Dataset from Foundation Models

Foundation models such as ChatGPT have made significant strides in robot...
research
07/20/2020

Non-Markov Policies to Reduce Sequential Failures in Robot Bin Picking

A new generation of automated bin picking systems using deep learning is...
research
02/27/2023

FRoGGeR: Fast Robust Grasp Generation via the Min-Weight Metric

Many approaches to grasp synthesis optimize analytic quality metrics tha...
research
09/10/2023

A Skeleton-based Approach For Rock Crack Detection Towards A Climbing Robot Application

Conventional wheeled robots are unable to traverse scientifically intere...
research
09/18/2021

Learning to Regrasp by Learning to Place

In this paper, we explore whether a robot can learn to regrasp a diverse...

Please sign up or login with your details

Forgot password? Click here to reset