Regularized Orthogonal Tensor Decompositions for Multi-Relational Learning

12/26/2015
by   Fanhua Shang, et al.
0

Multi-relational learning has received lots of attention from researchers in various research communities. Most existing methods either suffer from superlinear per-iteration cost, or are sensitive to the given ranks. To address both issues, we propose a scalable core tensor trace norm Regularized Orthogonal Iteration Decomposition (ROID) method for full or incomplete tensor analytics, which can be generalized as a graph Laplacian regularized version by using auxiliary information or a sparse higher-order orthogonal iteration (SHOOI) version. We first induce the equivalence relation of the Schatten p-norm (0<p<∞) of a low multi-linear rank tensor and its core tensor. Then we achieve a much smaller matrix trace norm minimization problem. Finally, we develop two efficient augmented Lagrange multiplier algorithms to solve our problems with convergence guarantees. Extensive experiments using both real and synthetic datasets, even though with only a few observations, verified both the efficiency and effectiveness of our methods.

READ FULL TEXT
research
03/12/2021

Rank properties and computational methods for orthogonal tensor decompositions

The orthogonal decomposition factorizes a tensor into a sum of an orthog...
research
05/23/2020

p-order Tensor Products with Invertible Linear Transforms

This paper studies the issues about tensors. Three typical kinds of tens...
research
09/06/2015

Theoretical and Experimental Analyses of Tensor-Based Regression and Classification

We theoretically and experimentally investigate tensor-based regression ...
research
09/25/2019

A Self-consistent-field Iteration for Orthogonal Canonical Correlation Analysis

We propose an efficient algorithm for solving orthogonal canonical corre...
research
06/27/2021

Sparse Logistic Tensor Decomposition for Binary Data

Tensor data are increasingly available in many application domains. We d...
research
02/12/2020

Deep Multi-Task Learning via Generalized Tensor Trace Norm

The trace norm is widely used in multi-task learning as it can discover ...
research
02/28/2018

Tractable and Scalable Schatten Quasi-Norm Approximations for Rank Minimization

The Schatten quasi-norm was introduced to bridge the gap between the tra...

Please sign up or login with your details

Forgot password? Click here to reset