Interactive Imitation Learning of Bimanual Movement Primitives

10/28/2022
by   Giovanni Franzese, et al.
0

Performing bimanual tasks with dual robotic setups can drastically increase the impact on industrial and daily life applications. However, performing a bimanual task brings many challenges, like synchronization and coordination of the single-arm policies. This article proposes the Safe, Interactive Movement Primitives Learning (SIMPLe) algorithm, to teach and correct single or dual arm impedance policies directly from human kinesthetic demonstrations. Moreover, it proposes a novel graph encoding of the policy based on Gaussian Process Regression (GPR) where the single-arm motion is guaranteed to converge close to the trajectory and then towards the demonstrated goal. A modulation of the robot stiffness according to the epistemic uncertainty of the policy allows for easily reshaping the motion with human feedback and/or adapting to external perturbations. We tested the SIMPLe algorithm on a real dual arm set up where the teacher gave separate single-arm demonstrations and then successfully synchronized them only using kinesthetic feedback or where the original bimanual demonstration was locally reshaped to pick a box at a different height.

READ FULL TEXT

page 1

page 5

page 7

page 8

page 10

research
12/12/2020

Learning Multi-Arm Manipulation Through Collaborative Teleoperation

Imitation Learning (IL) is a powerful paradigm to teach robots to perfor...
research
09/14/2023

Naturalistic Robot Arm Trajectory Generation via Representation Learning

The integration of manipulator robots in household environments suggests...
research
10/14/2022

Eliciting Compatible Demonstrations for Multi-Human Imitation Learning

Imitation learning from human-provided demonstrations is a strong approa...
research
03/05/2019

Uncertainty-Aware Imitation Learning using Kernelized Movement Primitives

During the past few years, probabilistic approaches to imitation learnin...
research
10/09/2021

Teaching Robots to Grasp Like Humans: An Interactive Approach

This work investigates how the intricate task of grasping may be learned...
research
05/25/2019

Learning and Composing Primitive Skills for Dual-arm Manipulation

In an attempt to confer robots with complex manipulation capabilities, d...
research
03/04/2021

ILoSA: Interactive Learning of Stiffness and Attractors

Teaching robots how to apply forces according to our preferences is stil...

Please sign up or login with your details

Forgot password? Click here to reset