Learning Efficient Tensor Representations with Ring Structure Networks

05/20/2017
by   Qibin Zhao, et al.
0

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of data dimensions makes solutions and TT-ranks of TT decomposition inconsistent. To alleviate this problem, we propose a permutation symmetric network structure by employing circular multilinear products over a sequence of low-order core tensors. This network structure can be graphically interpreted as a cyclic interconnection of tensors, and thus we call it tensor ring (TR) representation. We develop several efficient algorithms to learn TR representation with adaptive TR-ranks by employing low-rank approximations. Furthermore, mathematical properties are investigated, which enables us to perform basic operations in a computationally efficiently way by using TR representations. Experimental results on synthetic signals and real-world datasets demonstrate that the proposed TR network is more expressive and consistently informative than existing TT networks.

READ FULL TEXT
research
06/17/2016

Tensor Ring Decomposition

Tensor networks have in recent years emerged as the powerful tools for s...
research
11/09/2018

The trouble with tensor ring decompositions

The tensor train decomposition decomposes a tensor into a "train" of 3-w...
research
06/14/2022

Permutation Search of Tensor Network Structures via Local Sampling

Recent works put much effort into tensor network structure search (TN-SS...
research
04/18/2023

Large-scale Dynamic Network Representation via Tensor Ring Decomposition

Large-scale Dynamic Networks (LDNs) are becoming increasingly important ...
research
07/20/2023

Quaternion tensor ring decomposition and application for color image inpainting

In recent years, tensor networks have emerged as powerful tools for solv...
research
03/20/2023

Rethinking SO(3)-equivariance with Bilinear Tensor Networks

Many datasets in scientific and engineering applications are comprised o...
research
09/22/2020

Heuristic Rank Selection with Progressively Searching Tensor Ring Network

Recently, Tensor Ring Networks (TRNs) have been applied in deep networks...

Please sign up or login with your details

Forgot password? Click here to reset