Batch Quantum Reinforcement Learning

04/27/2023
by   Maniraman Periyasamy, et al.
13

Training DRL agents is often a time-consuming process as a large number of samples and environment interactions is required. This effect is even amplified in the case of Batch RL, where the agent is trained without environment interactions solely based on a set of previously collected data. Novel approaches based on quantum computing suggest an advantage compared to classical approaches in terms of sample efficiency. To investigate this advantage, we propose a batch RL algorithm leveraging VQC as function approximators in the discrete BCQ algorithm. Additionally, we present a novel data re-uploading scheme based on cyclically shifting the input variables' order in the data encoding layers. We show the efficiency of our algorithm on the OpenAI CartPole environment and compare its performance to classical neural network-based discrete BCQ.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/01/2021

Variational Quantum Reinforcement Learning via Evolutionary Optimization

Recent advance in classical reinforcement learning (RL) and quantum comp...
research
02/16/2023

Quantum Computing Provides Exponential Regret Improvement in Episodic Reinforcement Learning

In this paper, we investigate the problem of episodic reinforcement lear...
research
09/03/2020

Sample-Efficient Automated Deep Reinforcement Learning

Despite significant progress in challenging problems across various doma...
research
02/10/2022

Uncovering Instabilities in Variational-Quantum Deep Q-Networks

Deep Reinforcement Learning (RL) has considerably advanced over the past...
research
08/06/2019

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents

The ability to generate appropriate verbal and non-verbal backchannels b...
research
07/03/2023

Achieving Stable Training of Reinforcement Learning Agents in Bimodal Environments through Batch Learning

Bimodal, stochastic environments present a challenge to typical Reinforc...

Please sign up or login with your details

Forgot password? Click here to reset