Learning to Detect Slip through Tactile Measures of the Contact Force Field and its Entropy

03/02/2023
by   Xiaohai Hu, et al.
1

Detection of slip during object grasping and manipulation plays a vital role in object handling. Existing solutions largely depend on visual information to devise a strategy for grasping. Nonetheless, in order to achieve proficiency akin to humans and achieve consistent grasping and manipulation of unfamiliar objects, the incorporation of artificial tactile sensing has become a necessity in robotic systems. In this work, we propose a novel physics-informed, data-driven method to detect slip continuously in real time. The GelSight Mini, an optical tactile sensor, is mounted on custom grippers to acquire tactile readings. Our work leverages the inhomogeneity of tactile sensor readings during slip events to develop distinctive features and formulates slip detection as a classification problem. To evaluate our approach, we test multiple data-driven models on 10 common objects under different loading conditions, textures, and materials. Our results show that the best classification algorithm achieves an average accuracy of 99 the application of this work in a dynamic robotic manipulation task in which real-time slip detection and prevention algorithm is implemented.

READ FULL TEXT

page 1

page 2

page 3

page 6

research
02/27/2018

Slip Detection with Combined Tactile and Visual Information

Slip detection plays a vital role in robotic manipulation and it has lon...
research
09/23/2021

Leveraging distributed contact force measurements for slip detection: a physics-based approach enabled by a data-driven tactile sensor

Grasping objects whose physical properties are unknown is still a great ...
research
02/23/2022

Visual-tactile sensing for Real-time liquid Volume Estimation in Grasping

We propose a deep visuo-tactile model for realtime estimation of the liq...
research
09/16/2023

DenseTact-Mini: An Optical Tactile Sensor for Grasping Multi-Scale Objects From Flat Surfaces

Dexterous manipulation, especially of small daily objects, continues to ...
research
04/15/2020

Neuromorphic Event-Based Slip Detection and suppression in Robotic Grasping and Manipulation

Slip detection is essential for robots to make robust grasping and fine ...
research
11/24/2022

Real-Time Marker Localization Learning for GelStereo Tactile Sensing

Visuotactile sensing technology is becoming more popular in tactile sens...
research
11/15/2022

Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic System

The game of Jenga represents an inspiring benchmark for developing innov...

Please sign up or login with your details

Forgot password? Click here to reset