PARAFAC2 AO-ADMM: Constraints in all modes

02/03/2021
by   Marie Roald, et al.
0

The PARAFAC2 model provides a flexible alternative to the popular CANDECOMP/PARAFAC (CP) model for tensor decompositions. Unlike CP, PARAFAC2 allows factor matrices in one mode (i.e., evolving mode) to change across tensor slices, which has proven useful for applications in different domains such as chemometrics, and neuroscience. However, the evolving mode of the PARAFAC2 model is traditionally modelled implicitly, which makes it challenging to regularise it. Currently, the only way to apply regularisation on that mode is with a flexible coupling approach, which finds the solution through regularised least-squares subproblems. In this work, we instead propose an alternating direction method of multipliers (ADMM)-based algorithm for fitting PARAFAC2 and widen the possible regularisation penalties to any proximable function. Our numerical experiments demonstrate that the proposed ADMM-based approach for PARAFAC2 can accurately recover the underlying components from simulated data while being both computationally efficient and flexible in terms of imposing constraints.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/04/2021

An AO-ADMM approach to constraining PARAFAC2 on all modes

Analyzing multi-way measurements with variations across one mode of the ...
research
02/14/2018

Nonnegative PARAFAC2: a flexible coupling approach

Modeling variability in tensor decomposition methods is one of the chall...
research
07/19/2020

A Flexible Optimization Framework for Regularized Matrix-Tensor Factorizations with Linear Couplings

Coupled matrix and tensor factorizations (CMTF) are frequently used to j...
research
10/24/2022

PARAFAC2-based Coupled Matrix and Tensor Factorizations

Coupled matrix and tensor factorizations (CMTF) have emerged as an effec...
research
06/13/2015

A Flexible and Efficient Algorithmic Framework for Constrained Matrix and Tensor Factorization

We propose a general algorithmic framework for constrained matrix and te...
research
01/22/2019

CAE-ADMM: Implicit Bitrate Optimization via ADMM-based Pruning in Compressive Autoencoders

We introduce CAE-ADMM (ADMM-pruned compressive autoencoder), a lossy ima...
research
10/09/2020

Concurrent Alternating Least Squares for multiple simultaneous Canonical Polyadic Decompositions

Tensor decompositions, such as CANDECOMP/PARAFAC (CP), are widely used i...

Please sign up or login with your details

Forgot password? Click here to reset