Recurrent Quantum Neural Networks

06/25/2020
by   Johannes Bausch, et al.
0

Recurrent neural networks are the foundation of many sequence-to-sequence models in machine learning, such as machine translation and speech synthesis. In contrast, applied quantum computing is in its infancy. Nevertheless there already exist quantum machine learning models such as variational quantum eigensolvers which have been used successfully e.g. in the context of energy minimization tasks. In this work we construct a quantum recurrent neural network (QRNN) with demonstrable performance on non-trivial tasks such as sequence learning and integer digit classification. The QRNN cell is built from parametrized quantum neurons, which, in conjunction with amplitude amplification, create a nonlinear activation of polynomials of its inputs and cell state, and allow the extraction of a probability distribution over predicted classes at each step. To study the model's performance, we provide an implementation in pytorch, which allows the relatively efficient optimization of parametrized quantum circuits with thousands of parameters. We establish a QRNN training setup by benchmarking optimization hyperparameters, and analyse suitable network topologies for simple memorisation and sequence prediction tasks from Elman's seminal paper (1990) on temporal structure learning. We then proceed to evaluate the QRNN on MNIST classification, both by feeding the QRNN each image pixel-by-pixel; and by utilising modern data augmentation as preprocessing step. Finally, we analyse to what extent the unitary nature of the network counteracts the vanishing gradient problem that plagues many existing quantum classifiers and classical RNNs.

READ FULL TEXT

page 14

page 28

research
03/10/2023

Variational Quantum Neural Networks (VQNNS) in Image Classification

Quantum machine learning has established as an interdisciplinary field t...
research
11/10/2022

A quantum neural network with efficient optimization and interpretability

As the quantum counterparts to the classical artificial neural networks ...
research
02/07/2023

Quantum Recurrent Neural Networks for Sequential Learning

Quantum neural network (QNN) is one of the promising directions where th...
research
03/20/2022

Variational Quantum Policy Gradients with an Application to Quantum Control

Quantum Machine Learning models are composed by Variational Quantum Circ...
research
09/26/2019

Quantum Graph Neural Networks

We introduce Quantum Graph Neural Networks (QGNN), a new class of quantu...
research
01/19/2023

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition

Binary neural networks, i.e., neural networks whose parameters and activ...
research
02/23/2022

Completely Quantum Neural Networks

Artificial neural networks are at the heart of modern deep learning algo...

Please sign up or login with your details

Forgot password? Click here to reset