Compact Neural Networks based on the Multiscale Entanglement Renormalization Ansatz

11/09/2017
by   Andrew Hallam, et al.
0

The goal of this paper is to demonstrate a method for tensorizing neural networks based upon an efficient way of approximating scale invariant quantum states, the Multi-scale Entanglement Renormalization Ansatz (MERA). We employ MERA as a replacement for linear layers in a neural network and test this implementation on the CIFAR-10 dataset. The proposed method outperforms factorization using tensor trains, providing greater compression for the same level of accuracy and greater accuracy for the same level of compression. We demonstrate MERA-layers with 3900 times fewer parameters and a reduction in accuracy of less than 1

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset