Learning to Shift Attention for Motion Generation

02/24/2021
by   You Zhou, et al.
0

One challenge of motion generation using robot learning from demonstration techniques is that human demonstrations follow a distribution with multiple modes for one task query. Previous approaches fail to capture all modes or tend to average modes of the demonstrations and thus generate invalid trajectories. The other difficulty is the small number of demonstrations that cannot cover the entire working space. To overcome this problem, a motion generation model with extrapolation ability is needed. Previous works restrict task queries as local frames and learn representations in local frames. We propose a model to solve both problems. For multiple modes, we suggest to learn local latent representations of motion trajectories with a density estimation method based on real-valued non-volume preserving (RealNVP) transformations that provides a set of powerful, stably invertible, and learnable transformations. To improve the extrapolation ability, we propose to shift the attention of the robot from one local frame to another during the task execution. In experiments, we consider the docking problem used also in previous works where a trajectory has to be generated to connect two dockers without collision. We increase complexity of the task and show that the proposed method outperforms other approaches. In addition, we evaluate the approach in real robot experiments.

READ FULL TEXT

page 1

page 5

page 6

research
03/24/2023

Learning from Few Demonstrations with Frame-Weighted Motion Generation

Learning from Demonstration (LfD) aims to encode versatile skills from h...
research
05/25/2023

PRIMP: PRobabilistically-Informed Motion Primitives for Efficient Affordance Learning from Demonstration

This paper proposes a learning-from-demonstration method using probabili...
research
11/13/2019

Motion Reasoning for Goal-Based Imitation Learning

We address goal-based imitation learning, where the aim is to output the...
research
05/19/2023

Contact Optimization with Learning from Demonstration: Application in Long-term Non-prehensile Planar Manipulation

Long-term non-prehensile planar manipulation is a challenging task for p...
research
08/09/2023

Neural Field Movement Primitives for Joint Modelling of Scenes and Motions

This paper presents a novel Learning from Demonstration (LfD) method tha...
research
08/05/2020

Learning from Sparse Demonstrations

This paper proposes an approach which enables a robot to learn an object...
research
10/02/2018

Towards Online Learning from Corrective Demonstrations

Robots operating in real-world human environments will likely encounter ...

Please sign up or login with your details

Forgot password? Click here to reset