iCLAP: Shape Recognition by Combining Proprioception and Touch Sensing

06/19/2018
by   Shan Luo, et al.
0

For humans, both the proprioception and touch sensing are highly utilized when performing haptic perception. However, most approaches in robotics use only either proprioceptive data or touch data in haptic object recognition. In this paper, we present a novel method named Iterative Closest Labeled Point (iCLAP) to link the kinesthetic cues and tactile patterns fundamentally and also introduce its extensions to recognize object shapes. In the training phase, the iCLAP first clusters the features of tactile readings into a codebook and assigns these features with distinct label numbers. A 4D point cloud of the object is then formed by taking the label numbers of the tactile features as an additional dimension to the 3D sensor positions; hence, the two sensing modalities are merged to achieve a synthesized perception of the touched object. Furthermore, we developed and validated hybrid fusion strategies, product based and weighted sum based, to combine decisions obtained from iCLAP and single sensing modalities. Extensive experimentation demonstrates a dramatic improvement of object recognition using the proposed methods and it shows great potential to enhance robot perception ability.

READ FULL TEXT
research
02/21/2018

ViTac: Feature Sharing between Vision and Tactile Sensing for Cloth Texture Recognition

Vision and touch are two of the important sensing modalities for humans ...
research
06/10/2023

Bayesian and Neural Inference on LSTM-based Object Recognition from Tactile and Kinesthetic Information

Recent advances in the field of intelligent robotic manipulation pursue ...
research
11/10/2017

Robotic Tactile Perception of Object Properties: A Review

Touch sensing can help robots understand their sur- rounding environment...
research
11/18/2020

Seeing Through your Skin: Recognizing Objects with a Novel Visuotactile Sensor

We introduce a new class of vision-based sensor and associated algorithm...
research
09/19/2022

TANDEM3D: Active Tactile Exploration for 3D Object Recognition

Tactile recognition of 3D objects remains a challenging task. Compared t...
research
11/07/2022

Soft Robotic Link with Controllable Transparency for Vision-based Tactile and Proximity Sensing

Robots have been brought to work close to humans in many scenarios. For ...
research
03/22/2022

Visuo-Haptic Object Perception for Robots: An Overview

This article summarizes the current state of multimodal object perceptio...

Please sign up or login with your details

Forgot password? Click here to reset