DeepAI AI Chat
Log In Sign Up

An Optimal Online Method of Selecting Source Policies for Reinforcement Learning

by   Siyuan Li, et al.

Transfer learning significantly accelerates the reinforcement learning process by exploiting relevant knowledge from previous experiences. The problem of optimally selecting source policies during the learning process is of great importance yet challenging. There has been little theoretical analysis of this problem. In this paper, we develop an optimal online method to select source policies for reinforcement learning. This method formulates online source policy selection as a multi-armed bandit problem and augments Q-learning with policy reuse. We provide theoretical guarantees of the optimal selection process and convergence to the optimal policy. In addition, we conduct experiments on a grid-based robot navigation domain to demonstrate its efficiency and robustness by comparing to the state-of-the-art transfer learning method.


page 4

page 6


Context-Aware Policy Reuse

Transfer learning can greatly speed up reinforcement learning for a new ...

Cross-Domain Transfer in Reinforcement Learning using Target Apprentice

In this paper, we present a new approach to Transfer Learning (TL) in Re...

Joint Learning of Policy with Unknown Temporal Constraints for Safe Reinforcement Learning

In many real-world applications, safety constraints for reinforcement le...

Theoretical Guarantees of Transfer Learning

Transfer learning has been proven effective when within-target labeled d...

Experience Selection Using Dynamics Similarity for Efficient Multi-Source Transfer Learning Between Robots

In the robotics literature, different knowledge transfer approaches have...

Online Observer-Based Inverse Reinforcement Learning

In this paper, a novel approach to the output-feedback inverse reinforce...

Hierarchical Reinforcement Learning: Approximating Optimal Discounted TSP Using Local Policies

In this work, we provide theoretical guarantees for reward decomposition...