Robust Inverse Reinforcement Learning under Transition Dynamics Mismatch

07/02/2020 ∙ by Luca Viano, et al. ∙ 0

We study the inverse reinforcement learning (IRL) problem under the transition dynamics mismatch between the expert and the learner. In particular, we consider the Maximum Causal Entropy (MCE) IRL learner model and provide an upper bound on the learner's performance degradation based on the ℓ_1-distance between the two transition dynamics of the expert and the learner. Then, by leveraging insights from the Robust RL literature, we propose a robust MCE IRL algorithm, which is a principled approach to help with this mismatch issue. Finally, we empirically demonstrate the stable performance of our algorithm compared to the standard MCE IRL algorithm under transition mismatches in finite MDP problems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

page 31

page 33

page 34

page 35

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.