DeepAI AI Chat
Log In Sign Up

Explaining Imitation Learning through Frames

by   Boyuan Zheng, et al.
University of Technology Sydney

As one of the prevalent methods to achieve automation systems, Imitation Learning (IL) presents a promising performance in a wide range of domains. However, despite the considerable improvement in policy performance, the corresponding research on the explainability of IL models is still limited. Inspired by the recent approaches in explainable artificial intelligence methods, we proposed a model-agnostic explaining framework for IL models called R2RISE. R2RISE aims to explain the overall policy performance with respect to the frames in demonstrations. It iteratively retrains the black-box IL model from the randomized masked demonstrations and uses the conventional evaluation outcome environment returns as the coefficient to build an importance map. We also conducted experiments to investigate three major questions concerning frames' importance equality, the effectiveness of the importance map, and connections between importance maps from different IL models. The result shows that R2RISE successfully distinguishes important frames from the demonstrations.


page 2

page 4

page 6


Genetic Imitation Learning by Reward Extrapolation

Imitation learning demonstrates remarkable performance in various domain...

Ranking-Based Reward Extrapolation without Rankings

The performance of imitation learning is typically upper-bounded by the ...

Confidence-Aware Imitation Learning from Demonstrations with Varying Optimality

Most existing imitation learning approaches assume the demonstrations ar...

Out-of-Dynamics Imitation Learning from Multimodal Demonstrations

Existing imitation learning works mainly assume that the demonstrator wh...

Unsupervised Imitation Learning

We introduce a novel method to learn a policy from unsupervised demonstr...

Explainable Hierarchical Imitation Learning for Robotic Drink Pouring

To accurately pour drinks into various containers is an essential skill ...