Explaining Imitation Learning through Frames

01/03/2023
by   Boyuan Zheng, et al.
0

As one of the prevalent methods to achieve automation systems, Imitation Learning (IL) presents a promising performance in a wide range of domains. However, despite the considerable improvement in policy performance, the corresponding research on the explainability of IL models is still limited. Inspired by the recent approaches in explainable artificial intelligence methods, we proposed a model-agnostic explaining framework for IL models called R2RISE. R2RISE aims to explain the overall policy performance with respect to the frames in demonstrations. It iteratively retrains the black-box IL model from the randomized masked demonstrations and uses the conventional evaluation outcome environment returns as the coefficient to build an importance map. We also conducted experiments to investigate three major questions concerning frames' importance equality, the effectiveness of the importance map, and connections between importance maps from different IL models. The result shows that R2RISE successfully distinguishes important frames from the demonstrations.

READ FULL TEXT

page 2

page 4

page 6

research
01/03/2023

Genetic Imitation Learning by Reward Extrapolation

Imitation learning demonstrates remarkable performance in various domain...
research
07/09/2019

Ranking-Based Reward Extrapolation without Rankings

The performance of imitation learning is typically upper-bounded by the ...
research
10/27/2021

Confidence-Aware Imitation Learning from Demonstrations with Varying Optimality

Most existing imitation learning approaches assume the demonstrations ar...
research
11/13/2022

Out-of-Dynamics Imitation Learning from Multimodal Demonstrations

Existing imitation learning works mainly assume that the demonstrator wh...
research
06/19/2018

Unsupervised Imitation Learning

We introduce a novel method to learn a policy from unsupervised demonstr...
research
05/16/2021

Explainable Hierarchical Imitation Learning for Robotic Drink Pouring

To accurately pour drinks into various containers is an essential skill ...

Please sign up or login with your details

Forgot password? Click here to reset