Ground truth force distribution for learning-based tactile sensing: a finite element approach

09/09/2019
by   Carmelo Sferrazza, et al.
0

Skin-like tactile sensors provide robots with rich feedback related to the force distribution applied to their soft surface. The complexity of interpreting raw tactile information has driven the use of machine learning algorithms to convert the sensory feedback to the quantities of interest. However, the lack of ground truth sources for the entire contact force distribution has mainly limited these techniques to the sole estimation of the total contact force and the contact center on the sensor's surface. The method presented in this article uses a finite element model to obtain ground truth data for the three-dimensional force distribution. The model is obtained with state-of-the-art material characterization methods and is evaluated in an indentation setup, where it shows high agreement with the measurements retrieved from a commercial force-torque sensor. The proposed technique is applied to a vision-based tactile sensor, which aims to reconstruct the contact force distribution purely from images. Thousands of images are matched to ground truth data and are used to train a neural network architecture, which is suitable for real-time predictions.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

page 9

page 10

page 11

research
10/10/2018

Dense Tactile Force Distribution Estimation using GelSlim and inverse FEM

In this paper, we present a new version of tactile sensor GelSlim 2.0 wi...
research
12/21/2020

Sim-to-real for high-resolution optical tactile sensing: From images to 3D contact force distributions

The images captured by vision-based tactile sensors carry information ab...
research
10/15/2018

Robust Learning of Tactile Force Estimation through Robot Interaction

Current methods for estimating force from tactile sensor signals are eit...
research
02/06/2023

Learning to Predict Grip Quality from Simulation: Establishing a Digital Twin to Generate Simulated Data for a Grip Stability Metric

A robust grip is key to successful manipulation and joining of work piec...
research
03/05/2020

Learning the sense of touch in simulation: a sim-to-real strategy for vision-based tactile sensing

Data-driven approaches to tactile sensing aim to overcome the complexity...
research
12/07/2020

Learning Tactile Models for Factor Graph-based State Estimation

We address the problem of estimating object pose from touch during manip...
research
11/10/2021

A soft thumb-sized vision-based sensor with accurate all-round force perception

Vision-based haptic sensors have emerged as a promising approach to robo...

Please sign up or login with your details

Forgot password? Click here to reset