GradTac: Spatio-Temporal Gradient Based Tactile Sensing

03/14/2022
by   Kanishka Ganguly, et al.
0

Tactile sensing for robotics is achieved through a variety of mechanisms, including magnetic, optical-tactile, and conductive fluid. Currently, the fluid-based sensors have struck the right balance of anthropomorphic sizes and shapes and accuracy of tactile response measurement. However, this design is plagued by a low Signal to Noise Ratio (SNR) due to the fluid based sensing mechanism "damping" the measurement values that are hard to model. To this end, we present a spatio-temporal gradient representation on the data obtained from fluid-based tactile sensors, which is inspired from neuromorphic principles of event based sensing. We present a novel algorithm (GradTac) that converts discrete data points from spatial tactile sensors into spatio-temporal surfaces and tracks tactile contours across these surfaces. Processing the tactile data using the proposed spatio-temporal domain is robust, makes it less susceptible to the inherent noise from the fluid based sensors, and allows accurate tracking of regions of touch as compared to using the raw data. We successfully evaluate and demonstrate the efficacy of GradTac on many real-world experiments performed using the Shadow Dexterous Hand, equipped with the BioTac SP sensors. Specifically, we use it for tracking tactile input across the sensor's surface, measuring relative forces, detecting linear and rotational slip, and for edge tracking. We also release an accompanying task-agnostic dataset for the BioTac SP, which we hope will provide a resource to compare and quantify various novel approaches, and motivate further research.

READ FULL TEXT

page 1

page 5

page 7

page 8

page 9

page 11

page 12

research
08/10/2020

Spatio-temporal Attention Model for Tactile Texture Recognition

Recently, tactile sensing has attracted great interest in robotics, espe...
research
05/08/2020

ST-MNIST – The Spiking Tactile MNIST Neuromorphic Dataset

Tactile sensing is an essential modality for smart robots as it enables ...
research
05/30/2022

Braille Letter Reading: A Benchmark for Spatio-Temporal Pattern Recognition on Neuromorphic Hardware

Spatio-temporal pattern recognition is a fundamental ability of the brai...
research
03/23/2018

Hardware based Spatio-Temporal Neural Processing Backend for Imaging Sensors: Towards a Smart Camera

In this work we show how we can build a technology platform for cognitiv...
research
07/03/2023

A Biomimetic Fingerprint for Robotic Tactile Sensing

Tactile sensors have been developed since the early '70s and have greatl...
research
10/27/2020

Spatio-temporal encoding improves neuromorphic tactile texture classification

With the increase in interest in deployment of robots in unstructured en...
research
02/14/2020

Spatio-Temporal Coverage Enhancement in Drive-By Sensing Through Utility-Aware Mobile Agent Selection

In recent years, the drive-by sensing paradigm has become increasingly p...

Please sign up or login with your details

Forgot password? Click here to reset