Policy Optimization with Sparse Global Contrastive Explanations

07/13/2022
by   Jiayu Yao, et al.
0

We develop a Reinforcement Learning (RL) framework for improving an existing behavior policy via sparse, user-interpretable changes. Our goal is to make minimal changes while gaining as much benefit as possible. We define a minimal change as having a sparse, global contrastive explanation between the original and proposed policy. We improve the current policy with the constraint of keeping that global contrastive explanation short. We demonstrate our framework with a discrete MDP and a continuous 2D navigation domain.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset