Accept Synthetic Objects as Real: End-to-End Training of Attentive Deep Visuomotor Policies for Manipulation in Clutter

09/24/2019
by   Pooya Abolghasemi, et al.
21

Recent research demonstrated that it is feasible to end-to-end train multi-task deep visuomotor policies for robotic manipulation using variations of learning from demonstration (LfD) and reinforcement learning (RL). In this paper, we extend the capabilities of end-to-end LfD architectures to object manipulation in clutter. We start by introducing a data augmentation procedure called Accept Synthetic Objects as Real (ASOR). Using ASOR we develop two network architectures: implicit attention ASOR-IA and explicit attention ASOR-EA. Both architectures use the same training data (demonstrations in uncluttered environments) as previous approaches. Experimental results show that ASOR-IA and ASOR-EA succeed ina significant fraction of trials in cluttered environments where previous approaches never succeed. In addition, we find that both ASOR-IA and ASOR-EA outperform previous approaches even in uncluttered environments, with ASOR-EA performing better even in clutter compared to the previous best baseline in an uncluttered environment.

READ FULL TEXT

page 3

page 5

page 6

research
08/02/2019

Combining learned skills and reinforcement learning for robotic manipulations

Manipulation tasks such as preparing a meal or assembling furniture rema...
research
06/22/2023

FlowBot++: Learning Generalized Articulated Objects Manipulation via Articulation Projection

Understanding and manipulating articulated objects, such as doors and dr...
research
12/14/2020

A Framework for Efficient Robotic Manipulation

Data-efficient learning of manipulation policies from visual observation...
research
11/04/2021

Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning

Dexterous manipulation of arbitrary objects, a fundamental daily task fo...
research
09/06/2023

Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulation

Recent studies have verified that equivariant methods can significantly ...
research
09/26/2018

Pay attention! - Robustifying a Deep Visuomotor Policy through Task-Focused Attention

Several recent projects demonstrated the promise of end-to-end learned d...
research
09/19/2020

DEAP Cache: Deep Eviction Admission and Prefetching for Cache

Recent approaches for learning policies to improve caching, target just ...

Please sign up or login with your details

Forgot password? Click here to reset