A Flexible Optimization Framework for Regularized Matrix-Tensor Factorizations with Linear Couplings

07/19/2020
by   Carla Schenker, et al.
0

Coupled matrix and tensor factorizations (CMTF) are frequently used to jointly analyze data from multiple sources, also called data fusion. However, different characteristics of datasets stemming from multiple sources pose many challenges in data fusion and require to employ various regularizations, constraints, loss functions and different types of coupling structures between datasets. In this paper, we propose a flexible algorithmic framework for coupled matrix and tensor factorizations which utilizes Alternating Optimization (AO) and the Alternating Direction Method of Multipliers (ADMM). The framework facilitates the use of a variety of constraints, loss functions and couplings with linear transformations in a seamless way. Numerical experiments on simulated and real datasets demonstrate that the proposed approach is accurate, and computationally efficient with comparable or better performance than available CMTF methods for Frobenius norm loss, while being more flexible. Using Kullback-Leibler divergence on count data, we demonstrate that the algorithm yields accurate results also for other loss functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2022

PARAFAC2-based Coupled Matrix and Tensor Factorizations

Coupled matrix and tensor factorizations (CMTF) have emerged as an effec...
research
02/03/2021

PARAFAC2 AO-ADMM: Constraints in all modes

The PARAFAC2 model provides a flexible alternative to the popular CANDEC...
research
06/21/2022

A consistent and flexible framework for deep matrix factorizations

Deep matrix factorizations (deep MFs) are recent unsupervised data minin...
research
06/13/2015

A Flexible and Efficient Algorithmic Framework for Constrained Matrix and Tensor Factorization

We propose a general algorithmic framework for constrained matrix and te...
research
09/06/2015

Theoretical and Experimental Analyses of Tensor-Based Regression and Classification

We theoretically and experimentally investigate tensor-based regression ...
research
05/17/2011

All-at-once Optimization for Coupled Matrix and Tensor Factorizations

Joint analysis of data from multiple sources has the potential to improv...
research
10/04/2021

An AO-ADMM approach to constraining PARAFAC2 on all modes

Analyzing multi-way measurements with variations across one mode of the ...

Please sign up or login with your details

Forgot password? Click here to reset