An AO-ADMM approach to constraining PARAFAC2 on all modes

10/04/2021
by   Marie Roald, et al.
0

Analyzing multi-way measurements with variations across one mode of the dataset is a challenge in various fields including data mining, neuroscience and chemometrics. For example, measurements may evolve over time or have unaligned time profiles. The PARAFAC2 model has been successfully used to analyze such data by allowing the underlying factor matrices in one mode (i.e., the evolving mode) to change across slices. The traditional approach to fit a PARAFAC2 model is to use an alternating least squares-based algorithm, which handles the constant cross-product constraint of the PARAFAC2 model by implicitly estimating the evolving factor matrices. This approach makes imposing regularization on these factor matrices challenging. There is currently no algorithm to flexibly impose such regularization with general penalty functions and hard constraints. In order to address this challenge and to avoid the implicit estimation, in this paper, we propose an algorithm for fitting PARAFAC2 based on alternating optimization with the alternating direction method of multipliers (AO-ADMM). With numerical experiments on simulated data, we show that the proposed PARAFAC2 AO-ADMM approach allows for flexible constraints, recovers the underlying patterns accurately, and is computationally efficient compared to the state-of-the-art. We also apply our model to a real-world chromatography dataset, and show that constraining the evolving mode improves the interpretability of the extracted patterns.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2021

PARAFAC2 AO-ADMM: Constraints in all modes

The PARAFAC2 model provides a flexible alternative to the popular CANDEC...
research
10/24/2022

PARAFAC2-based Coupled Matrix and Tensor Factorizations

Coupled matrix and tensor factorizations (CMTF) have emerged as an effec...
research
02/28/2023

Modular and Parallelizable Multibody Physics Simulation via Subsystem-Based ADMM

In this paper, we present a new multibody physics simulation framework t...
research
08/14/2023

A Time-aware tensor decomposition for tracking evolving patterns

Time-evolving data sets can often be arranged as a higher-order tensor w...
research
12/31/2021

Training Recurrent Neural Networks by Sequential Least Squares and the Alternating Direction Method of Multipliers

For training recurrent neural network models of nonlinear dynamical syst...
research
07/19/2020

A Flexible Optimization Framework for Regularized Matrix-Tensor Factorizations with Linear Couplings

Coupled matrix and tensor factorizations (CMTF) are frequently used to j...
research
08/04/2019

Simultaneous Clustering and Optimization for Evolving Datasets

Simultaneous clustering and optimization (SCO) has recently drawn much a...

Please sign up or login with your details

Forgot password? Click here to reset