Visual Tactile Sensor Based Force Estimation for Position-Force Teleoperation

12/26/2022
by   Yaonan Zhu, et al.
0

Vision-based tactile sensors have gained extensive attention in the robotics community. The sensors are highly expected to be capable of extracting contact information i.e. haptic information during in-hand manipulation. This nature of tactile sensors makes them a perfect match for haptic feedback applications. In this paper, we propose a contact force estimation method using the vision-based tactile sensor DIGIT, and apply it to a position-force teleoperation architecture for force feedback. The force estimation is done by building a depth map for DIGIT gel surface deformation measurement and applying a regression algorithm on estimated depth data and ground truth force data to get the depth-force relationship. The experiment is performed by constructing a grasping force feedback system with a haptic device as a leader robot and a parallel robot gripper as a follower robot, where the DIGIT sensor is attached to the tip of the robot gripper to estimate the contact force. The preliminary results show the capability of using the low-cost vision-based sensor for force feedback applications.

READ FULL TEXT

page 3

page 4

research
06/22/2019

Effective Estimation of Contact Force and Torque for Vision-based Tactile Sensor with Helmholtz-Hodge Decomposition

Retrieving rich contact information from robotic tactile sensing has bee...
research
05/03/2021

Viko: An Adaptive Gecko Gripper with Vision-based Tactile Sensor

Monitoring the state of contact is essential for robotic devices, especi...
research
08/28/2023

9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

The advancements in vision-based tactile sensors have boosted the aptitu...
research
05/30/2021

Deformation Control of a Deformable Object Based on Visual and Tactile Feedback

In this paper, we presented a new method for deformation control of defo...
research
03/08/2019

Joint Inference of Kinematic and Force Trajectories with Visuo-Tactile Sensing

To perform complex tasks, robots must be able to interact with and manip...
research
10/31/2018

Maintaining Grasps within Slipping Bound by Monitoring Incipient Slip

In this paper, we propose an approach to detect incipient slip, i.e. pre...
research
11/09/2021

Using The Feedback of Dynamic Active-Pixel Vision Sensor (Davis) to Prevent Slip in Real Time

The objective of this paper is to describe an approach to detect the sli...

Please sign up or login with your details

Forgot password? Click here to reset