Generalized Canonical Polyadic Tensor Decomposition

08/22/2018
by   David Hong, et al.
0

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback-Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety statistically-motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. We demonstrate the flexibility of GCP on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

06/04/2019

Stochastic Gradients for Large-Scale Tensor Decomposition

Tensor decomposition is a well-known tool for multiway data analysis. Th...
02/23/2022

Canonical Polyadic Decomposition via the generalized Schur decomposition

The canonical polyadic decomposition (CPD) is a fundamental tensor decom...
06/27/2021

Sparse Logistic Tensor Decomposition for Binary Data

Tensor data are increasingly available in many application domains. We d...
12/02/2020

Parameter Sensitivity Analysis of the SparTen High Performance Sparse Tensor Decomposition Software: Extended Analysis

Tensor decomposition models play an increasingly important role in moder...
04/29/2021

Stochastic Mirror Descent for Low-Rank Tensor Decomposition Under Non-Euclidean Losses

This work considers low-rank canonical polyadic decomposition (CPD) unde...
12/15/2021

A recursive eigenspace computation for the Canonical Polyadic decomposition

The canonical polyadic decomposition (CPD) is a compact decomposition wh...
06/08/2020

All your loss are belong to Bayes

Loss functions are a cornerstone of machine learning and the starting po...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.