Stochastic Gradients for Large-Scale Tensor Decomposition

06/04/2019
by   Tamara G. Kolda, et al.
0

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is a recently proposed version of tensor decomposition that allows for a variety of loss functions such as logistic loss for binary data or Huber loss for robust estimation. The stochastic gradient is formed from randomly sampled elements of the tensor. For dense tensors, we simply use uniform sampling. For sparse tensors, we propose two types of stratified sampling that give precedence to sampling nonzeros. Numerical results demonstrate the advantages of the proposed approach and its scalability to large-scale problems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

04/29/2021

Stochastic Mirror Descent for Low-Rank Tensor Decomposition Under Non-Euclidean Losses

This work considers low-rank canonical polyadic decomposition (CPD) unde...
08/22/2018

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning meth...
05/10/2021

A Coupled Random Projection Approach to Large-Scale Canonical Polyadic Decomposition

We propose a novel algorithm for the computation of canonical polyadic d...
04/03/2017

Dictionary-based Tensor Canonical Polyadic Decomposition

To ensure interpretability of extracted sources in tensor decomposition,...
11/13/2017

Tensor Decompositions for Modeling Inverse Dynamics

Modeling inverse dynamics is crucial for accurate feedforward robot cont...
01/16/2019

Block-Randomized Stochastic Proximal Gradient for Low-Rank Tensor Factorization

This work considers the problem of computing the canonical polyadic deco...
01/07/2019

Randomized Tensor Ring Decomposition and Its Application to Large-scale Data Reconstruction

Dimensionality reduction is an essential technique for multi-way large-s...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.