Learning Human Body Motions from Skeleton-Based Observations for Robot-Assisted Therapy

07/25/2022
by   Natalia Quiroga, et al.
0

Robots applied in therapeutic scenarios, for instance in the therapy of individuals with Autism Spectrum Disorder, are sometimes used for imitation learning activities in which a person needs to repeat motions by the robot. To simplify the task of incorporating new types of motions that a robot can perform, it is desirable that the robot has the ability to learn motions by observing demonstrations from a human, such as a therapist. In this paper, we investigate an approach for acquiring motions from skeleton observations of a human, which are collected by a robot-centric RGB-D camera. Given a sequence of observations of various joints, the joint positions are mapped to match the configuration of a robot before being executed by a PID position controller. We evaluate the method, in particular the reproduction error, by performing a study with QTrobot in which the robot acquired different upper-body dance moves from multiple participants. The results indicate the method's overall feasibility, but also indicate that the reproduction quality is affected by noise in the skeleton observations.

READ FULL TEXT
research
12/02/2018

Teleoperation of a Humanoid Robot with Motion Imitation and Legged Locomotion

This work presents a teleoperated humanoid robot system that can imitate...
research
03/03/2020

Modeling and Control of a Hybrid Wheeled Jumping Robot

In this paper, we study a wheeled robot with a prismatic extension joint...
research
10/09/2022

Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweening

Human motion synthesis is a long-standing problem with various applicati...
research
04/19/2023

Applying Learning-from-observation to household service robots: three common-sense formulation

Utilizing a robot in a new application requires the robot to be programm...
research
09/17/2019

Configuration-Space Flipper Planning on 3D Terrain

Autonomous run is always a goal in the field of rescue robot and the uti...
research
03/31/2020

HATSUKI : An anime character like robot figure platform with anime-style expressions and imitation learning based action generation

Japanese character figurines are popular and have pivot position in Otak...

Please sign up or login with your details

Forgot password? Click here to reset