Variational Quantum Policy Gradients with an Application to Quantum Control

03/20/2022
by   André Sequeira, et al.
0

Quantum Machine Learning models are composed by Variational Quantum Circuits (VQCs) in a very natural way. There are already some empirical results proving that such models provide an advantage in supervised/unsupervised learning tasks. However, when applied to Reinforcement Learning (RL), less is known. In this work, we consider Policy Gradients using a hardware-efficient ansatz. We prove that the complexity of obtaining an ϵ-approximation of the gradient using quantum hardware scales only logarithmically with the number of parameters, considering the number of quantum circuits executions. We test the performance of such models in benchmarking environments and verify empirically that such quantum models outperform typical classical neural networks used in those environments, using a fraction of the number of parameters. Moreover, we propose the utilization of the Fisher Information spectrum to show that the quantum model is less prone to barren plateaus than its classical counterpart. As a different use case, we consider the application of such variational quantum models to the problem of quantum control and show its feasibility in the quantum-quantum domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/09/2021

Variational quantum policies for reinforcement learning

Variational quantum circuits have recently gained popularity as quantum ...
research
10/30/2020

The power of quantum neural networks

Fault-tolerant quantum computers offer the promise of dramatically impro...
research
11/23/2022

Benchmarking variational quantum circuits with permutation symmetry

We propose SnCQA, a set of hardware-efficient variational circuits of eq...
research
09/07/2021

Optimizing Quantum Variational Circuits with Deep Reinforcement Learning

Quantum Machine Learning (QML) is considered to be one of the most promi...
research
06/25/2020

Recurrent Quantum Neural Networks

Recurrent neural networks are the foundation of many sequence-to-sequenc...
research
02/12/2018

Taking gradients through experiments: LSTMs and memory proximal policy optimization for black-box quantum control

In this work we introduce the application of black-box quantum control a...
research
06/08/2022

Predict better with less training data using a QNN

Over the past decade, machine learning revolutionized vision-based quali...

Please sign up or login with your details

Forgot password? Click here to reset