Finger Grip Force Estimation from Video using Two Stream Approach

03/05/2018
by   Andrey Sartison, et al.
0

Estimation of a hand grip force is essential for the understanding of force pattern during the execution of assembly or disassembly operations. Human demonstration of a correct way of doing an operation is a powerful source of information which can be used for guided robot teaching. Typically to assess this problem instrumented approach is used, which requires hand or object mounted devices and poses an inconvenience for an operator or limits the scope of addressable objects. The work demonstrates that contact force may be estimated using a noninvasive contactless method with the help of vision system alone. We propose a two-stream approach for video processing, which utilizes both spatial information of each frame and dynamic information of frame change. In this work, image processing and machine learning techniques are used along with dense optical flow for frame change tracking and Kalman filter is used for stream fusion. Our studies show that the proposed method can successfully estimate contact grip force with RMSE < 10 N), the performances of each stream and overall method performance are reported. The proposed method has a wide range of applications, including robot teaching through demonstration, haptic force feedback, and validation of human- performed operations.

READ FULL TEXT

page 3

page 4

research
03/10/2021

Combining Learning from Demonstration with Learning by Exploration to Facilitate Contact-Rich Tasks

Collaborative robots are expected to be able to work alongside humans an...
research
11/20/2021

Imitation and Supervised Learning of Compliance for Robotic Assembly

We present the design of a learning-based compliance controller for asse...
research
11/07/2018

Learning Task Constraints from Demonstration for Hybrid Force/Position Control

We present a novel method for learning hybrid force/position control fro...
research
03/30/2023

Differentiable Environment Primitives for Contact State Estimation

In contact-rich manipulation, the robot dynamics are coupled with an env...
research
04/03/2022

Impact Intensity Estimation of a Quadruped Robot without Using a Force Sensor

Estimating the impact intensity is one of the significant tasks of the l...
research
03/07/2023

Proprioceptive Sensor-Based Simultaneous Multi-Contact Point Localization and Force Identification for Robotic Arms

In this paper, we propose an algorithm that estimates contact point and ...
research
03/17/2023

Experimental verification of an online traction parameter identification method

Traction parameters, that characterize the ground-wheel contact dynamics...

Please sign up or login with your details

Forgot password? Click here to reset