DeepAI AI Chat
Log In Sign Up

Knowledge Induced Deep Q-Network for a Slide-to-Wall Object Grasping

by   Hengyue Liang, et al.
University of Minnesota

In robotic grasping tasks, robots usually avoid any collisions with the environment and exclusively interact with the target objects. However, the environment can facilitate grasping rather than being obstacles. Indeed, interacting with the environment sometimes provides an alternative strategy when it is not possible to grasp from the top. One example of such tasks is the Slide-to-Wall grasping, where the target object needs to be pushed towards a wall before a feasible grasp can be applied. In this paper, we propose an approach that actively exploits the environment to grasp objects. We formulate the Slide-to-Wall grasping problem as a Markov Decision Process and propose a reinforcement learning approach. Though a standard Deep Q-Network (DQN) method is capable of solving MDP problems, it does not effectively generalize to unseen environment settings that are different from training. To tackle the generalization challenge, we propose a Knowledge Induced DQN (KI-DQN) that not only trains more effectively, but also outperforms the standard DQN significantly in testing cases with unseen walls, and can be directly tested on real robots without fine-tuning while DQN cannot.


page 1

page 3

page 4

page 5

page 6


Deep 6-DoF Tracking of Unknown Objects for Reactive Grasping

Robotic manipulation of unknown objects is an important field of researc...

Attribute-Based Robotic Grasping with One-Grasp Adaptation

Robotic grasping is one of the most fundamental robotic manipulation tas...

Multi-Object Grasping – Generating Efficient Robotic Picking and Transferring Policy

Transferring multiple objects between bins is a common task for many app...

Exploratory Grasping: Asymptotically Optimal Algorithms for Grasping Challenging Polyhedral Objects

There has been significant recent work on data-driven algorithms for lea...

Robotic Grasp Manipulation Using Evolutionary Computing and Deep Reinforcement Learning

Intelligent Object manipulation for grasping is a challenging problem fo...

A Pushing-Grasping Collaborative Method Based on Deep Q-Network Algorithm in Dual Perspectives

Aiming at the traditional grasping method for manipulators based on 2D c...

Learning to Grasp the Ungraspable with Emergent Extrinsic Dexterity

A simple gripper can solve more complex manipulation tasks if it can uti...