Dynamic Movement Primitive based Motion Retargeting for Dual-Arm Sign Language Motions

11/08/2020
by   Yuwei Liang, et al.
0

We aim to develop an efficient programming method for equipping service robots with the skill of performing sign language motions. This paper addresses the problem of transferring complex dual-arm sign language motions characterized by the coordination among arms and hands from human to robot, which is seldom considered in previous studies of motion retargeting techniques. In this paper, we propose a novel motion retargeting method that leverages graph optimization and Dynamic Movement Primitives (DMPs) for this problem. We employ DMPs in a leader-follower manner to parameterize the original trajectories while preserving motion rhythm and relative movements between human body parts, and adopt a three-step optimization procedure to find deformed trajectories for robot motion planning while ensuring feasibility for robot execution. Experimental results of several Chinese Sign Language (CSL) motions have been successfully performed on ABB's YuMi dual-arm collaborative robot (14-DOF) with two 6-DOF Inspire-Robotics' multi-fingered hands, a system with 26 DOFs in total.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

research
08/02/2022

A Riemannian Take on Human Motion Analysis and Retargeting

Dynamic motions of humans and robots are widely driven by posture-depend...
research
03/16/2021

Human-Robot Motion Retargeting via Neural Latent Optimization

Motion retargeting from human to robot remains a very challenging task d...
research
05/12/2022

Robot Cooking with Stir-fry: Bimanual Non-prehensile Manipulation of Semi-fluid Objects

This letter describes an approach to achieve well-known Chinese cooking ...
research
05/03/2019

Asymmetric Dual-Arm Task Execution using an Extended Relative Jacobian

Dual-armed coordination is a classical problem in robotics, which gained...
research
02/10/2021

Manipulability optimization for multi-arm teleoperation

Teleoperation provides a way for human operators to guide robots in situ...
research
08/12/2021

Put the Bear on the Chair! Intelligent Robot Interaction with Previously Unseen Objects via Robot Imagination

In this letter, we study the problem of autonomously placing a teddy bea...
research
06/17/2022

Efficiently Learning Single-Arm Fling Motions to Smooth Garments

Recent work has shown that 2-arm "fling" motions can be effective for ga...

Please sign up or login with your details

Forgot password? Click here to reset