Towards Affordance Prediction with Vision via Task Oriented Grasp Quality Metrics

07/10/2019
by   Luca Cavalli, et al.
1

While many quality metrics exist to evaluate the quality of a grasp by itself, no clear quantification of the quality of a grasp relatively to the task the grasp is used for has been defined yet. In this paper we propose a framework to extend the concept of grasp quality metric to task-oriented grasping by defining affordance functions via basic grasp metrics for an open set of task affordances. We evaluate both the effectivity of the proposed task oriented metrics and their practical applicability by learning to infer them from vision. Indeed, we assess the validity of our novel framework both in the context of perfect information, i.e., known object model, and in the partial information context, i.e., inferring task oriented metrics from vision, underlining advantages and limitations of both situations. In the former, physical metrics of grasp hypotheses on an object are defined and computed in known object model simulation, in the latter deep models are trained to infer such properties from partial information in the form of synthesized range images.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
09/20/2023

Task-Oriented Grasping with Point Cloud Representation of Objects

In this paper, we study the problem of task-oriented grasp synthesis fro...
research
09/10/2018

Grasp success prediction with quality metrics

Current robotic manipulation requires reliable methods to predict whethe...
research
10/16/2022

Learning 6-DoF Task-oriented Grasp Detection via Implicit Estimation and Visual Affordance

Currently, task-oriented grasp detection approaches are mostly based on ...
research
09/24/2019

Minimal Work: A Grasp Quality Metric for Deformable Hollow Objects

Robot grasping of deformable hollow objects such as plastic bottles and ...
research
09/14/2023

Language Embedded Radiance Fields for Zero-Shot Task-Oriented Grasping

Grasping objects by a specific part is often crucial for safety and for ...
research
11/04/2021

Learning suction graspability considering grasp quality and robot reachability for bin-picking

Deep learning has been widely used for inferring robust grasps. Although...
research
05/12/2023

Vision and Control for Grasping Clear Plastic Bags

We develop two novel vision methods for planning effective grasps for cl...

Please sign up or login with your details

Forgot password? Click here to reset