A quantum algorithm for training wide and deep classical neural networks

07/19/2021
by   Alexander Zlokapa, et al.
10

Given the success of deep learning in classical machine learning, quantum algorithms for traditional neural network architectures may provide one of the most promising settings for quantum machine learning. Considering a fully-connected feedforward neural network, we show that conditions amenable to classical trainability via gradient descent coincide with those necessary for efficiently solving quantum linear systems. We propose a quantum algorithm to approximately train a wide and deep neural network up to O(1/n) error for a training set of size n by performing sparse matrix inversion in O(log n) time. To achieve an end-to-end exponential speedup over gradient descent, the data distribution must permit efficient state preparation and readout. We numerically demonstrate that the MNIST image dataset satisfies such conditions; moreover, the quantum algorithm matches the accuracy of the fully-connected network. Beyond the proven architecture, we provide empirical evidence for O(log n) training of a convolutional neural network with pooling.

READ FULL TEXT

page 6

page 21

page 22

research
10/21/2020

Quantum Deformed Neural Networks

We develop a new quantum neural network layer designed to run efficientl...
research
06/10/2021

Quantum Natural Gradient for Variational Bayes

Variational Bayes (VB) is a critical method in machine learning and stat...
research
02/12/2023

Quantum Neuron Selection: Finding High Performing Subnetworks With Quantum Algorithms

Gradient descent methods have long been the de facto standard for traini...
research
07/11/2022

Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm

Although learning in high dimensions is commonly believed to suffer from...
research
10/16/2020

A case where a spindly two-layer linear network whips any neural network with a fully connected input layer

It was conjectured that any neural network of any structure and arbitrar...
research
12/07/2018

Quantum algorithms for feedforward neural networks

Quantum machine learning has the potential for broad industrial applicat...
research
05/28/2019

Image classification using quantum inference on the D-Wave 2X

We use a quantum annealing D-Wave 2X computer to obtain solutions to NP-...

Please sign up or login with your details

Forgot password? Click here to reset