MVGrasp: Real-Time Multi-View 3D Object Grasping in Highly Cluttered Environments

03/19/2021
by   Hamidreza Kasaei, et al.
0

Nowadays service robots are entering more and more in our daily life. In such a dynamic environment, a robot frequently faces pile, packed, or isolated objects. Therefore, it is necessary for the robot to know how to grasp and manipulate various objects in different situations to help humans in everyday tasks. Most state-of-the-art grasping approaches addressed four degrees-of-freedom (DoF) object grasping, where the robot is forced to grasp objects from above based on grasp synthesis of a given top-down scene. Although such approaches showed a very good performance in predefined industrial settings, they are not suitable for human-centric environments as the robot will not able to grasp a range of household objects robustly, for example, grasping a bottle from above is not stable. In this work, we propose a multi-view deep learning approach to handle robust object grasping in human-centric domains. In particular, our approach takes a partial point cloud of a scene as an input, and then, generates multi-views of existing objects. The obtained views of each object are used to estimate pixel-wise grasp synthesis for each object. To evaluate the performance of the proposed approach, we performed extensive experiments in both simulation and real-world environments within the pile, packed, and isolated objects scenarios. Experimental results showed that our approach can estimate appropriate grasp configurations in only 22ms without the need for explicit collision checking. Therefore, the proposed approach can be used in real-time robotic applications that need closed-loop grasp planning.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
06/03/2021

Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domains

A robot working in human-centric environments needs to know which kind o...
research
10/07/2022

GraspCaps: Capsule Networks Are All You Need for Grasping Familiar Objects

As robots become more accessible outside of industrial settings, the nee...
research
03/04/2022

Self-Supervised Learning for Joint Pushing and Grasping Policies in Highly Cluttered Environments

Robots often face situations where grasping a goal object is desirable b...
research
01/04/2021

Volumetric Grasping Network: Real-time 6 DOF Grasp Detection in Clutter

General robot grasping in clutter requires the ability to synthesize gra...
research
09/18/2020

6-DoF Grasp Planning using Fast 3D Reconstruction and Grasp Quality CNN

Recent consumer demand for home robots has accelerated performance of ro...
research
03/30/2022

PEGG-Net: Background Agnostic Pixel-Wise Efficient Grasp Generation Under Closed-Loop Conditions

Performing closed-loop grasping at close proximity to an object requires...
research
12/01/2020

Fast and Robust Bin-picking System for Densely Piled Industrial Objects

Objects grasping, also known as the bin-picking, is one of the most comm...

Please sign up or login with your details

Forgot password? Click here to reset