Spatio-temporal Attention Model for Tactile Texture Recognition

08/10/2020
by   Guanqun Cao, et al.
7

Recently, tactile sensing has attracted great interest in robotics, especially for facilitating exploration of unstructured environments and effective manipulation. A detailed understanding of the surface textures via tactile sensing is essential for many of these tasks. Previous works on texture recognition using camera based tactile sensors have been limited to treating all regions in one tactile image or all samples in one tactile sequence equally, which includes much irrelevant or redundant information. In this paper, we propose a novel Spatio-Temporal Attention Model (STAM) for tactile texture recognition, which is the very first of its kind to our best knowledge. The proposed STAM pays attention to both spatial focus of each single tactile texture and the temporal correlation of a tactile sequence. In the experiments to discriminate 100 different fabric textures, the spatially and temporally selective attention has resulted in a significant improvement of the recognition accuracy, by up to 18.8 models. Specifically, after introducing noisy data that is collected before the contact happens, our proposed STAM can learn the salient features efficiently and the accuracy can increase by 15.23 baseline approach. The improved tactile texture perception can be applied to facilitate robot tasks like grasping and manipulation.

READ FULL TEXT

page 1

page 3

page 5

page 7

research
12/28/2021

Multimodal perception for dexterous manipulation

Humans usually perceive the world in a multimodal way that vision, touch...
research
04/05/2022

Artificial SA-I, RA-I and RA-II/Vibrotactile Afferents for Tactile Sensing of Texture

Robot touch can benefit from how humans perceive tactile textural inform...
research
03/01/2020

NeuroTac: A Neuromorphic Optical Tactile Sensor applied to Texture Recognition

Developing artificial tactile sensing capabilities that rival human touc...
research
02/21/2018

ViTac: Feature Sharing between Vision and Tactile Sensing for Cloth Texture Recognition

Vision and touch are two of the important sensing modalities for humans ...
research
03/14/2022

GradTac: Spatio-Temporal Gradient Based Tactile Sensing

Tactile sensing for robotics is achieved through a variety of mechanisms...
research
10/27/2020

Spatio-temporal encoding improves neuromorphic tactile texture classification

With the increase in interest in deployment of robots in unstructured en...
research
04/29/2020

Teaching Cameras to Feel: Estimating Tactile Physical Properties of Surfaces From Images

The connection between visual input and tactile sensing is critical for ...

Please sign up or login with your details

Forgot password? Click here to reset