Functional mimicry of Ruffini receptors with Fiber Bragg Gratings and Deep Neural Networks enables a bio-inspired large-area tactile sensitive skin

03/23/2022
by   Luca Massari, et al.
0

Collaborative robots are expected to physically interact with humans in daily living and workplace, including industrial and healthcare settings. A related key enabling technology is tactile sensing, which currently requires addressing the outstanding scientific challenge to simultaneously detect contact location and intensity by means of soft conformable artificial skins adapting over large areas to the complex curved geometries of robot embodiments. In this work, the development of a large-area sensitive soft skin with a curved geometry is presented, allowing for robot total-body coverage through modular patches. The biomimetic skin consists of a soft polymeric matrix, resembling a human forearm, embedded with photonic Fiber Bragg Grating (FBG) transducers, which partially mimics Ruffini mechanoreceptor functionality with diffuse, overlapping receptive fields. A Convolutional Neural Network deep learning algorithm and a multigrid Neuron Integration Process were implemented to decode the FBG sensor outputs for inferring contact force magnitude and localization through the skin surface. Results achieved 35 mN (IQR = 56 mN) and 3.2 mm (IQR = 2.3 mm) median errors, for force and localization predictions, respectively. Demonstrations with an anthropomorphic arm pave the way towards AI-based integrated skins enabling safe human-robot cooperation via machine intelligence.

READ FULL TEXT

page 8

page 10

page 11

page 29

page 30

research
08/10/2019

Color-Coded Fiber-Optic Tactile Sensor for an Elastomeric Robot Skin

The sense of touch is essential for reliable mapping between the environ...
research
02/03/2022

Optical skin: Sensor-integration-free multimodal flexible sensing

The biological skin enables animals to sense various stimuli. Extensive ...
research
07/19/2023

AcousTac: Tactile sensing with acoustic resonance for electronics-free soft skin

Sound is a rich information medium that transmits through air; people co...
research
09/21/2018

Contact modelling and tactile data processing for robot skin

Tactile sensing is a key enabling technology to develop complex behaviou...
research
05/02/2023

Touch and deformation perception of soft manipulators with capacitive e-skins and deep learning

Tactile sensing in soft robots remains particularly challenging because ...
research
03/18/2022

Effect of Active and Passive Protective Soft Skins on Collision Forces in Human-robot Collaboration

Soft electronic skins are one of the means to turn an industrial manipul...
research
05/05/2020

Detection of Human Contact by Thermal Exchange Observer of Robot Skin

Physical human-robot interaction (pHRI) enables to achieve various assis...

Please sign up or login with your details

Forgot password? Click here to reset