CNN-based Methods for Object Recognition with High-Resolution Tactile Sensors

05/21/2023
by   Juan M. Gandarias, et al.
0

Novel high-resolution pressure-sensor arrays allow treating pressure readings as standard images. Computer vision algorithms and methods such as Convolutional Neural Networks (CNN) can be used to identify contact objects. In this paper, a high-resolution tactile sensor has been attached to a robotic end-effector to identify contacted objects. Two CNN-based approaches have been employed to classify pressure images. These methods include a transfer learning approach using a pre-trained CNN on an RGB-images dataset and a custom-made CNN (TactNet) trained from scratch with tactile information. The transfer learning approach can be carried out by retraining the classification layers of the network or replacing these layers with an SVM. Overall, 11 configurations based on these methods have been tested: 8 transfer learning-based, and 3 TactNet-based. Moreover, a study of the performance of the methods and a comparative discussion with the current state-of-the-art on tactile object recognition is presented.

READ FULL TEXT

page 1

page 2

page 4

page 7

research
06/10/2023

Bayesian and Neural Inference on LSTM-based Object Recognition from Tactile and Kinesthetic Information

Recent advances in the field of intelligent robotic manipulation pursue ...
research
09/28/2022

DTact: A Vision-Based Tactile Sensor that Measures High-Resolution 3D Geometry Directly from Darkness

Vision-based tactile sensors that can measure 3D geometry of the contact...
research
03/16/2020

OmniTact: A Multi-Directional High Resolution Touch Sensor

Incorporating touch as a sensing modality for robots can enable finer an...
research
12/07/2018

Transfer learning for vision-based tactile sensing

Due to the complexity of modeling the elastic properties of materials, t...
research
07/22/2021

MobileCharger: an Autonomous Mobile Robot with Inverted Delta Actuator for Robust and Safe Robot Charging

MobileCharger is a novel mobile charging robot with an Inverted Delta ac...
research
01/27/2022

Pressure Eye: In-bed Contact Pressure Estimation via Contact-less Imaging

Computer vision has achieved great success in interpreting semantic mean...
research
02/09/2021

Deep Multilabel CNN for Forensic Footwear Impression Descriptor Identification

In recent years deep neural networks have become the workhorse of comput...

Please sign up or login with your details

Forgot password? Click here to reset