Simple Kinesthetic Haptics for Object Recognition

06/11/2022
by   Avishai Sintov, et al.
0

Object recognition is an essential capability when performing various tasks. Humans naturally use either or both visual and tactile perception to extract object class and properties. Typical approaches for robots, however, require complex visual systems or multiple high-density tactile sensors which can be highly expensive. In addition, they usually require actual collection of a large dataset from real objects through direct interaction. In this paper, we propose a kinesthetic-based object recognition method that can be performed with any multi-fingered robotic hand in which the kinematics is known. The method does not require tactile sensors and is based on observing grasps of the objects. We utilize a unique and frame invariant parameterization of grasps to learn instances of object shapes. To train a classifier, training data is generated rapidly and solely in a computational process without interaction with real objects. We then propose and compare between two iterative algorithms that can integrate any trained classifier. The classifiers and algorithms are independent of any particular robot hand and, therefore, can be exerted on various ones. We show in experiments, that with few grasps, the algorithms acquire accurate classification. Furthermore, we show that the object recognition approach is scalable to objects of various sizes. Similarly, a global classifier is trained to identify general geometries (e.g., an ellipsoid or a box) rather than particular ones and demonstrated on a large set of objects. Full scale experiments and analysis are provided to show the performance of the method.

READ FULL TEXT

page 1

page 12

page 16

page 17

page 18

page 19

page 20

research
06/10/2023

Bayesian and Neural Inference on LSTM-based Object Recognition from Tactile and Kinesthetic Information

Recent advances in the field of intelligent robotic manipulation pursue ...
research
03/09/2018

Deep Visuo-Tactile Learning: Estimation of Material Properties from Images

Estimation of materials properties, such as softness or roughness from v...
research
05/09/2022

Multi-Fingered In-Hand Manipulation with Various Object Properties Using Graph Convolutional Networks and Distributed Tactile Sensors

Multi-fingered hands could be used to achieve many dexterous manipulatio...
research
03/08/2019

Learning to Identify Object Instances by Touch: Tactile Recognition via Multimodal Matching

Much of the literature on robotic perception focuses on the visual modal...
research
09/16/2021

ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations

Multisensory object-centric perception, reasoning, and interaction have ...
research
09/15/2019

Identifying Multiple Interaction Events from Tactile Data during Robot-Human Object Transfer

During a robot to human object handover task, several intended or uninte...
research
09/19/2022

TANDEM3D: Active Tactile Exploration for 3D Object Recognition

Tactile recognition of 3D objects remains a challenging task. Compared t...

Please sign up or login with your details

Forgot password? Click here to reset