Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision

06/25/2018
by   Kuan Fang, et al.
8

Tool manipulation is vital for facilitating robots to complete challenging task goals. It requires reasoning about the desired effect of the task and thus properly grasping and manipulating the tool to achieve the task. Task-agnostic grasping optimizes for grasp robustness while ignoring crucial task-specific constraints. In this paper, we propose the Task-Oriented Grasping Network (TOG-Net) to jointly optimize both task-oriented grasping of a tool and the manipulation policy for that tool. The training process of the model is based on large-scale simulated self-supervision with procedurally generated tool objects. We perform both simulated and real-world experiments on two tool-based manipulation tasks: sweeping and hammering. Our model achieves overall 71.1 task success rate for sweeping and 80.0 Supplementary material is available at: bit.ly/task-oriented-grasp

READ FULL TEXT

page 1

page 3

page 7

page 8

research
02/28/2023

Task-Oriented Grasp Prediction with Visual-Language Inputs

To perform household tasks, assistive robots receive commands in the for...
research
11/27/2021

GATER: Learning Grasp-Action-Target Embeddings and Relations for Task-Specific Grasping

Intelligent service robots require the ability to perform a variety of t...
research
04/03/2023

A Simple Approach for General Task-Oriented Picking using Placing constraints

Pick-and-place is an important manipulation task in domestic or manufact...
research
09/16/2023

GRaCE: Optimizing Grasps to Satisfy Ranked Criteria in Complex Scenarios

This paper addresses the multi-faceted problem of robot grasping, where ...
research
03/09/2023

Cherry-Picking with Reinforcement Learning

Grasping small objects surrounded by unstable or non-rigid material play...
research
10/05/2016

Supervision via Competition: Robot Adversaries for Learning Tasks

There has been a recent paradigm shift in robotics to data-driven learni...
research
06/18/2020

A Mechanical Screwing Tool for 2-Finger Parallel Grippers – Design, Optimization, and Manipulation Policies

This paper develops a mechanical tool as well as its manipulation polici...

Please sign up or login with your details

Forgot password? Click here to reset