A Fast Implementation for the Canonical Polyadic Decomposition

12/05/2019
by   Felipe Bottega Diniz, et al.
0

A new implementation of the canonical polyadic decomposition (CPD) is presented. It features lower computational complexity and memory usage than the available state of art implementations available. The CPD of tensors is a challenging problem which has been approached in several manners. Alternating least squares algorithms were used for a long time, but they convergence properties are limited. Nonlinear least squares (NLS) algorithms - more precisely, damped Gauss-Newton (dGN) algorithms - are much better in this sense, but they require inverting large Hessians, and for this reason there is just a few implementations using this approach. In this paper, we propose a fast dGN implementation to compute the CPD. In this paper, we make the case to always compress the tensor, and propose a fast damped Gauss-Newton implementation to compute the canonical polyadic decomposition.

READ FULL TEXT
research
04/27/2020

Analysis of the Stochastic Alternating Least Squares Method for the Decomposition of Random Tensors

Stochastic Alternating Least Squares (SALS) is a method that approximate...
research
10/12/2021

Tensor decompositions and algorithms, with applications to tensor learning

A new algorithm of the canonical polyadic decomposition (CPD) presented ...
research
10/27/2019

Comparison of Accuracy and Scalability of Gauss-Newton and Alternating Least Squares for CP Decomposition

Alternating least squares is the most widely used algorithm for CP tenso...
research
07/16/2014

Large scale canonical correlation analysis with iterative least squares

Canonical Correlation Analysis (CCA) is a widely used statistical tool w...
research
01/19/2017

Efficient Implementation Of Newton-Raphson Methods For Sequential Data Prediction

We investigate the problem of sequential linear data prediction for real...
research
05/01/2014

Fast MLE Computation for the Dirichlet Multinomial

Given a collection of categorical data, we want to find the parameters o...
research
12/07/2021

Accelerating jackknife resampling for the Canonical Polyadic Decomposition

The Canonical Polyadic (CP) tensor decomposition is frequently used as a...

Please sign up or login with your details

Forgot password? Click here to reset