Estimating Fingertip Forces, Torques, and Local Curvatures from Fingernail Images

09/09/2019
by   Nutan Chen, et al.
0

The study of dexterous manipulation has provided important insights in humans sensorimotor control as well as inspiration for manipulation strategies in robotic hands. Previous work focused on experimental environment with restrictions. Here we describe a method using the deformation and color distribution of the fingernail and its surrounding skin, to estimate the fingertip forces, torques and contact surface curvatures for various objects, including the shape and material of the contact surfaces and the weight of the objects. The proposed method circumvents limitations associated with sensorized objects, gloves or fixed contact surface type. In addition, compared with previous single finger estimation in an experimental environment, we extend the approach to multiple finger force estimation, which can be used for applications such as human grasping analysis. Four algorithms are used, c.q., Gaussian process (GP), Convolutional Neural Networks (CNN), Neural Networks with Fast Dropout (NN-FD) and Recurrent Neural Networks with Fast Dropout (RNN-FD), to model a mapping from images to the corresponding labels. The results further show that the proposed method has high accuracy to predict force, torque and contact surface.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 9

page 14

research
02/05/2020

Force-guided High-precision Grasping Control of Fragile and Deformable Objects using sEMG-based Force Prediction

Regulating contact forces with high precision is crucial for grasping an...
research
04/12/2023

Force Map: Learning to Predict Contact Force Distribution from Vision

When humans see a scene, they can roughly imagine the forces applied to ...
research
03/22/2023

Theoretical Model Construction of Deformation-Force for Soft Grippers Part II: Displacement Control Based Intrinsic Force Sensing

Compliant grasping is an essential capability for most robots in practic...
research
09/20/2023

From Unstable Contacts to Stable Control: A Deep Learning Paradigm for HD-sEMG in Neurorobotics

In the past decade, there has been significant advancement in designing ...
research
08/03/2023

No Free Slide: Spurious Contact Forces in Incremental Potential Contact

Modeling contact between deformable solids is a fundamental problem in c...
research
11/09/2022

Sensing and Control of Friction Mode for Contact Area Variable Surfaces (Friction-variable Surface Structure)

Robotic hands with soft surfaces can perform stable grasping, but the hi...
research
11/19/2018

Watermark Retrieval from 3D Printed Objects via Convolutional Neural Networks

We present a method for reading digital data embedded in planar 3D print...

Please sign up or login with your details

Forgot password? Click here to reset