Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environment

02/21/2023
by   Yuhong Deng, et al.
0

In this paper, a novel robotic grasping system is established to automatically pick up objects in cluttered scenes. A composite robotic hand composed of a suction cup and a gripper is designed for grasping the object stably. The suction cup is used for lifting the object from the clutter first and the gripper for grasping the object accordingly. We utilize the affordance map to provide pixel-wise lifting point candidates for the suction cup. To obtain a good affordance map, the active exploration mechanism is introduced to the system. An effective metric is designed to calculate the reward for the current affordance map, and a deep Q-Network (DQN) is employed to guide the robotic hand to actively explore the environment until the generated affordance map is suitable for grasping. Experimental results have demonstrated that the proposed robotic grasping system is able to greatly increase the success rate of the robotic grasping in cluttered scenes.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
03/17/2023

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Robotic dexterous grasping is a challenging problem due to the high degr...
research
01/04/2021

A Pushing-Grasping Collaborative Method Based on Deep Q-Network Algorithm in Dual Perspectives

Aiming at the traditional grasping method for manipulators based on 2D c...
research
05/14/2021

Domestic waste detection and grasping points for robotic picking up

This paper presents an AI system applied to location and robotic graspin...
research
04/28/2020

Transferable Active Grasping and Real Embodied Dataset

Grasping in cluttered scenes is challenging for robot vision systems, as...
research
01/25/2021

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

The method of deep learning has achieved excellent results in improving ...
research
02/07/2017

An Integrated Simulator and Dataset that Combines Grasping and Vision for Deep Learning

Deep learning is an established framework for learning hierarchical data...
research
09/28/2022

Human-in-the-loop Robotic Grasping using BERT Scene Representation

Current NLP techniques have been greatly applied in different domains. I...

Please sign up or login with your details

Forgot password? Click here to reset