Burn-In Demonstrations for Multi-Modal Imitation Learning

10/13/2017
by   Alex Kuefler, et al.
0

Recent work on imitation learning has generated policies that reproduce expert behavior from multi-modal data. However, past approaches have focused only on recreating a small number of distinct, expert maneuvers, or have relied on supervised learning techniques that produce unstable policies. This work extends InfoGAIL, an algorithm for multi-modal imitation learning, to reproduce behavior over an extended period of time. Our approach involves reformulating the typical imitation learning setting to include "burn-in demonstrations" upon which policies are conditioned at test time. We demonstrate that our approach outperforms standard InfoGAIL in maximizing the mutual information between predicted and unseen style labels in road scene simulations, and we show that our method leads to policies that imitate expert autonomous driving systems over long time horizons.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2020

Generalization Guarantees for Multi-Modal Imitation Learning

Control policies from imitation learning can often fail to generalize to...
research
05/19/2020

Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets

Generative adversarial imitation learning (GAIL) has shown promising res...
research
10/02/2019

Learning Calibratable Policies using Programmatic Style-Consistency

We study the important and challenging problem of controllable generatio...
research
05/30/2019

Imitation Learning as f-Divergence Minimization

We address the problem of imitation learning with multi-modal demonstrat...
research
05/22/2018

Maximum Causal Tsallis Entropy Imitation Learning

In this paper, we propose a novel maximum causal Tsallis entropy (MCTE) ...
research
10/15/2018

Deep Imitative Models for Flexible Inference, Planning, and Control

Imitation learning provides an appealing framework for autonomous contro...
research
03/29/2023

Specification-Guided Data Aggregation for Semantically Aware Imitation Learning

Advancements in simulation and formal methods-guided environment samplin...

Please sign up or login with your details

Forgot password? Click here to reset