TactileSGNet: A Spiking Graph Neural Network for Event-based Tactile Object Recognition

08/01/2020
by   Fuqiang Gu, et al.
0

Tactile perception is crucial for a variety of robot tasks including grasping and in-hand manipulation. New advances in flexible, event-driven, electronic skins may soon endow robots with touch perception capabilities similar to humans. These electronic skins respond asynchronously to changes (e.g., in pressure, temperature), and can be laid out irregularly on the robot's body or end-effector. However, these unique features may render current deep learning approaches such as convolutional feature extractors unsuitable for tactile learning. In this paper, we propose a novel spiking graph neural network for event-based tactile object recognition. To make use of local connectivity of taxels, we present several methods for organizing the tactile data in a graph structure. Based on the constructed graphs, we develop a spiking graph convolutional network. The event-driven nature of spiking neural network makes it arguably more suitable for processing the event-based data. Experimental results on two tactile datasets show that the proposed method outperforms other state-of-the-art spiking methods, achieving high accuracies of approximately 90% when classifying a variety of different household objects.

READ FULL TEXT
research
09/15/2020

Event-Driven Visual-Tactile Sensing and Learning for Robots

This work contributes an event-driven visual-tactile perception system, ...
research
10/09/2022

Boost Event-Driven Tactile Learning with Location Spiking Neurons

Tactile sensing is essential for a variety of daily tasks. And recent ad...
research
07/23/2022

Event-Driven Tactile Learning with Location Spiking Neurons

The sense of touch is essential for a variety of daily tasks. New advanc...
research
03/12/2022

Tactile-ViewGCN: Learning Shape Descriptor from Tactile Data using Graph Convolutional Network

For humans, our "senses of touch" have always been necessary for our abi...
research
05/08/2020

ST-MNIST – The Spiking Tactile MNIST Neuromorphic Dataset

Tactile sensing is an essential modality for smart robots as it enables ...
research
06/10/2023

Bayesian and Neural Inference on LSTM-based Object Recognition from Tactile and Kinesthetic Information

Recent advances in the field of intelligent robotic manipulation pursue ...
research
09/09/2021

Object recognition for robotics from tactile time series data utilising different neural network architectures

Robots need to exploit high-quality information on grasped objects to in...

Please sign up or login with your details

Forgot password? Click here to reset