Supervised learning with generalized tensor networks

06/15/2018
by   Ivan Glasser, et al.
0

Tensor networks have found a wide use in a variety of applications in physics and computer science, recently leading to both theoretical insights as well as practical algorithms in machine learning. In this work we explore the connection between tensor networks and probabilistic graphical models, and show that it motivates the definition of generalized tensor networks where information from a tensor can be copied and reused in other parts of the network. We discuss the relationship between generalized tensor network architectures used in quantum physics, such as String-Bond States and Entangled Plaquette States, and architectures commonly used in machine learning. We provide an algorithm to train these networks in a supervised learning context and show that they overcome the limitations of regular tensor networks in higher dimensions, while keeping the computation efficient. A method to combine neural networks and tensor networks as part of a common deep learning architecture is also introduced. We benchmark our algorithm for several generalized tensor network architectures on the task of classifying images and sounds, and show that they outperform previously introduced tensor network algorithms. Some of the models we consider can be realized on a quantum computer and may guide the development of near-term quantum machine learning architectures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2020

Quantum-Classical Machine learning by Hybrid Tensor Networks

Tensor networks (TN) have found a wide use in machine learning, and in p...
research
01/15/2023

Quantum-inspired tensor network for Earth science

Deep Learning (DL) is one of many successful methodologies to extract in...
research
03/03/2022

Improvements to Gradient Descent Methods for Quantum Tensor Network Machine Learning

Tensor networks have demonstrated significant value for machine learning...
research
02/24/2022

Physics solutions for machine learning privacy leaks

Machine learning systems are becoming more and more ubiquitous in increa...
research
05/26/2021

An Explainable Probabilistic Classifier for Categorical Data Inspired to Quantum Physics

This paper presents Sparse Tensor Classifier (STC), a supervised classif...
research
01/05/2020

On Stability of Tensor Networks and Canonical Forms

Tensor networks such as matrix product states (MPS) and projected entang...
research
10/27/2017

Tensor network language model

We propose a new statistical model suitable for machine learning of syst...

Please sign up or login with your details

Forgot password? Click here to reset