Imitation of Manipulation Skills Using Multiple Geometries

03/02/2022
by   Boyang Ti, et al.
0

Daily manipulation tasks are characterized by regular characteristics associated with the task structure, which can be described by multiple geometric primitives related to actions and object shapes. Such geometric descriptors can not be expressed only in Cartesian coordinate systems. In this paper, we propose a learning approach to extract the optimal representation from a dictionary of coordinate systems to represent an observed movement. This is achieved by using an extension of Gaussian distributions on Riemannian manifolds, which is used to analyse a set of user demonstrations statistically, by considering multiple geometries as candidate representations of the task. We formulate the reproduction problem as a general optimal control problem based on an iterative linear quadratic regulator (iLQR), where the Gaussian distribution in the extracted coordinate systems are used to define the cost function. We apply our approach to grasping and box opening tasks in simulation and on a 7-axis Franka Emika robot. The results show that the robot can exploit several geometries to execute the manipulation task and generalize it to new situations, by maintaining the invariant features of the skill in the coordinate system(s) of interest.

READ FULL TEXT

page 1

page 6

page 7

research
03/27/2019

Skill Acquisition via Automated Multi-Coordinate Cost Balancing

We propose a learning framework, named Multi-Coordinate Cost Balancing (...
research
11/19/2018

Generalizing Robot Imitation Learning with Invariant Hidden Semi-Markov Models

Generalizing manipulation skills to new situations requires extracting i...
research
06/03/2017

Visuospatial Skill Learning for Robots

A novel skill learning approach is proposed that allows a robot to acqui...
research
09/07/2022

K-VIL: Keypoints-based Visual Imitation Learning

Visual imitation learning provides efficient and intuitive solutions for...
research
03/07/2022

A Unified Formulation of Geometry-aware Dynamic Movement Primitives

Learning from demonstration (LfD) is considered as an efficient way to t...
research
12/14/2022

Geometric Algebra for Optimal Control with Applications in Manipulation Tasks

Many problems in robotics are fundamentally problems of geometry, which ...
research
10/20/2021

Periodic DMP formulation for Quaternion Trajectories

Imitation learning techniques have been used as a way to transfer skills...

Please sign up or login with your details

Forgot password? Click here to reset