Leveraging Tactile Sensors for Low Latency Embedded Smart Hands for Prosthetic and Robotic Applications

03/28/2022
by   Xiaying Wang, et al.
0

Tactile sensing is a crucial perception mode for robots and human amputees in need of controlling a prosthetic device. Today robotic and prosthetic systems are still missing the important feature of accurate tactile sensing. This lack is mainly due to the fact that the existing tactile technologies have limited spatial and temporal resolution and are either expensive or not scalable. In this paper, we present the design and the implementation of a hardware-software embedded system called SmartHand. It is specifically designed to enable the acquisition and the real-time processing of high-resolution tactile information from a hand-shaped multi-sensor array for prosthetic and robotic applications. During data collection, our system can deliver a high throughput of 100 frames per second, which is 13.7x higher than previous related work. We collected a new tactile dataset while interacting with daily-life objects during five different sessions. We propose a compact yet accurate convolutional neural network that requires one order of magnitude less memory and 15.6x fewer computations compared to related work without degrading classification accuracy. The top-1 and top-3 cross-validation accuracies are respectively 98.86 the best top-3 leave-one-out-validation accuracy of 77.84 trained model on a high-performance ARM Cortex-M7 microcontroller achieving an inference time of only 100 ms minimizing the response latency. The overall measured power consumption is 505 mW. Finally, we fabricate a new control sensor and perform additional experiments to provide analyses on sensor degradation and slip detection. This work is a step forward in giving robotic and prosthetic devices a sense of touch and demonstrates the practicality of a smart embedded system empowered by tiny machine learning.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 11

page 12

page 14

research
07/23/2021

SmartHand: Towards Embedded Smart Hands for Prosthetic and Robotic Applications

The sophisticated sense of touch of the human hand significantly contrib...
research
08/12/2020

GelTip: A Finger-shaped Optical Tactile Sensor for Robotic Manipulation

Sensing contacts throughout the fingers is an essential capability for a...
research
03/16/2020

OmniTact: A Multi-Directional High Resolution Touch Sensor

Incorporating touch as a sensing modality for robots can enable finer an...
research
03/12/2020

Reconfigurable Computing Applied to Latency Reduction for the Tactile Internet

Tactile internet applications allow robotic devices to be remotely contr...
research
11/10/2019

Embedded Neural Networks for Robot Autonomy

We present a library to automatically embed signal processing and neural...
research
06/12/2022

Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction

We investigate how high-resolution tactile sensors can be utilized in co...
research
12/08/2022

E-TRoll: Tactile Sensing and Classification via A Simple Robotic Gripper for Extended Rolling Manipulations

Robotic tactile sensing provides a method of recognizing objects and the...

Please sign up or login with your details

Forgot password? Click here to reset