DeepAI AI Chat
Log In Sign Up

Biomimetic Evaluation of an Underwater Soft Hand Through Deep Learning-based 3D Pose Reconstruction

by   Haihang Wang, et al.
Harbin Engineering University

Soft robotic hand shows considerable promise for various grasping applications. However, the sensing and reconstruction of the robot pose will cause limitation during the design and fabrication. In this work, we present a novel 3D pose reconstruction approach to analyze the grasping motion of a bidirectional soft robotic hand using experiment videos. The images from top, front, back, left, right view were collected using an one-camera-multiple-mirror imaging device. The coordinate and orientation information of soft fingers are detected based on deep learning methods. Faster RCNN model is used to detect the position of fingertips, while U-Net model is applied to calculate the side boundary of the fingers. Based on the kinematics, the corresponding coordinate and orientation databases are established. The 3D pose reconstructed result presents a satisfactory performance and good accuracy. Using efficacy coefficient method, the finger contribution of the bending angle and distance between fingers of soft robot hand is analyzed by compared with that of human hand. The results show that the soft robot hand perform a human-like motion in both single-direction and bidirectional grasping.


page 1

page 3

page 5

page 6


A Novel Design of Soft Robotic Hand with a Human-inspired Soft Palm for Dexterous Grasping

Soft robotic hands and grippers are increasingly attracting attention as...

BRL/Pisa/IIT SoftHand: A Low-cost, 3D-Printed, Underactuated, Tendon-Driven Hand with Soft and Adaptive Synergies

This paper introduces the BRL/Pisa/IIT (BPI) SoftHand: a single actuator...

A Multimodal, Enveloping Soft Gripper: Shape Conformation, Bioinspired Adhesion, and Expansion-Driven Suction

A key challenge in robotics is to create efficient methods for grasping ...

A Fabric Soft Robotic Exoskeleton with Novel Elastic Band Integrated Actuators for Hand Rehabilitation

Common disabilities like stroke and spinal cord injuries may cause loss ...

Tele-Operated Oropharyngeal Swab (TOOS) RobotEnabled by TSS Soft Hand for Safe and EffectiveCOVID-19 OP Sampling

The COVID-19 pandemic has imposed serious challenges in multiple perspec...