Sample-efficient Adversarial Imitation Learning from Observation

06/18/2019
by   Faraz Torabi, et al.
2

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex behaviors. However, these adversarial imitation algorithms often require many demonstration examples and learning iterations to produce a policy that is successful at imitating a demonstrator's behavior. This high sample complexity often prohibits these algorithms from being deployed on physical robots. In this paper, we propose an algorithm that addresses the sample inefficiency problem by utilizing ideas from trajectory centric reinforcement learning algorithms. We test our algorithm and conduct experiments using an imitation task on a physical robot arm and its simulated version in Gazebo and will show the improvement in learning rate and efficiency.

READ FULL TEXT
research
03/31/2021

DEALIO: Data-Efficient Adversarial Learning for Imitation from Observation

In imitation learning from observation IfO, a learning agent seeks to im...
research
05/08/2021

RAIL: A modular framework for Reinforcement-learning-based Adversarial Imitation Learning

While Adversarial Imitation Learning (AIL) algorithms have recently led ...
research
02/01/2022

Adversarial Imitation Learning from Video using a State Observer

The imitation learning research community has recently made significant ...
research
11/05/2020

HILONet: Hierarchical Imitation Learning from Non-Aligned Observations

It is challenging learning from demonstrated observation-only trajectori...
research
12/25/2020

RoCUS: Robot Controller Understanding via Sampling

As robots are deployed in complex situations, engineers and end users mu...
research
12/11/2021

Deterministic and Discriminative Imitation (D2-Imitation): Revisiting Adversarial Imitation for Sample Efficiency

Sample efficiency is crucial for imitation learning methods to be applic...
research
06/11/2017

Meta learning Framework for Automated Driving

The success of automated driving deployment is highly depending on the a...

Please sign up or login with your details

Forgot password? Click here to reset