Grasp-type Recognition Leveraging Object Affordance

08/26/2020
by   Naoki Wake, et al.
0

A key challenge in robot teaching is grasp-type recognition with a single RGB image and a target object name. Here, we propose a simple yet effective pipeline to enhance learning-based recognition by leveraging a prior distribution of grasp types for each object. In the pipeline, a convolutional neural network (CNN) recognizes the grasp type from an RGB image. The recognition result is further corrected using the prior distribution (i.e., affordance), which is associated with the target object name. Experimental results showed that the proposed method outperforms both a CNN-only and an affordance-only method. The results highlight the effectiveness of linguistically-driven object affordance for enhancing grasp-type recognition in robot teaching.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

02/27/2021

Object affordance as a guide for grasp-type recognition

Recognizing human grasping strategies is an important factor in robot te...
06/20/2017

Recognition of Grasp Points for Clothes Manipulation under unconstrained Conditions

In this work a system for recognizing grasp points in RGB-D images is pr...
01/25/2020

Multi-Fingered Grasp Planning via Inference in Deep Neural Networks

We propose a novel approach to multi-fingered grasp planning leveraging ...
09/08/2021

Egocentric View Hand Action Recognition by Leveraging Hand Surface and Hand Grasp Type

We introduce a multi-stage framework that uses mean curvature on a hand ...
03/03/2021

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

General object grasping is an important yet unsolved problem in the fiel...
08/16/2021

Intent-based Object Grasping by a Robot using Deep Learning

A robot needs to predict an ideal rectangle for optimal object grasping ...
08/07/2019

Grasp Type Estimation for Myoelectric Prostheses using Point Cloud Feature Learning

Prosthetic hands can help people with limb difference to return to their...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.