Deep quantum neural networks form Gaussian processes

05/17/2023
by   Diego García-Martín, et al.
0

It is well known that artificial neural networks initialized from independent and identically distributed priors converge to Gaussian processes in the limit of large number of neurons per hidden layer. In this work we prove an analogous result for Quantum Neural Networks (QNNs). Namely, we show that the outputs of certain models based on Haar random unitary or orthogonal deep QNNs converge to Gaussian processes in the limit of large Hilbert space dimension d. The derivation of this result is more nuanced than in the classical case due the role played by the input states, the measurement observable, and the fact that the entries of unitary matrices are not independent. An important consequence of our analysis is that the ensuing Gaussian processes cannot be used to efficiently predict the outputs of the QNN via Bayesian statistics. Furthermore, our theorems imply that the concentration of measure phenomenon in Haar random QNNs is much worse than previously thought, as we prove that expectation values and gradients concentrate as 𝒪(1/e^d √(d)) – exponentially in the Hilbert space dimension. Finally, we discuss how our results improve our understanding of concentration in t-designs.

READ FULL TEXT
research
07/04/2021

Random Neural Networks in the Infinite Width Limit as Gaussian Processes

This article gives a new proof that fully connected neural networks with...
research
09/30/2019

Non-Gaussian processes and neural networks at finite widths

Gaussian processes are ubiquitous in nature and engineering. A case in p...
research
08/26/2021

Estimation of Riemannian distances between covariance operators and Gaussian processes

In this work we study two Riemannian distances between infinite-dimensio...
research
11/04/2021

Rate of Convergence of Polynomial Networks to Gaussian Processes

We examine one-hidden-layer neural networks with random weights. It is w...
research
03/23/2020

Baryons from Mesons: A Machine Learning Perspective

Quantum chromodynamics (QCD) is the theory of the strong interaction. Th...
research
07/03/2021

Scale Mixtures of Neural Network Gaussian Processes

Recent works have revealed that infinitely-wide feed-forward or recurren...
research
04/21/2022

On a conjecture of Talagrand on selector processes and a consequence on positive empirical processes

For appropriate Gaussian processes, Michel Talagrand (1987) proved that ...

Please sign up or login with your details

Forgot password? Click here to reset