Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization

07/01/2019
by   Paul Pu Liang, et al.
17

There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these concerns, we present a regularization method based on tensor rank minimization. Our method is based on the observation that high-dimensional multimodal time series data often exhibit correlations across time and modalities which leads to low-rank tensor representations. However, the presence of noise or incomplete values breaks these correlations and results in tensor representations of higher rank. We design a model to learn such tensor representations and effectively regularize their rank. Experiments on multimodal language data show that our model achieves good results across various levels of imperfection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2018

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

Multimodal research is an emerging field of artificial intelligence, and...
research
04/13/2023

Solving Tensor Low Cycle Rank Approximation

Large language models have become ubiquitous in modern life, finding app...
research
06/18/2020

Low-Rank Autoregressive Tensor Completion for Multivariate Time Series Forecasting

Time series prediction has been a long-standing research topic and an es...
research
08/08/2022

Rank and Factor Loadings Estimation in Time Series Tensor Factor Model by Pre-averaging

Tensor time series data appears naturally in a lot of fields, including ...
research
01/12/2021

High-Dimensional Low-Rank Tensor Autoregressive Time Series Modeling

Modern technological advances have enabled an unprecedented amount of st...
research
04/05/2018

Missing Slice Recovery for Tensors Using a Low-rank Model in Embedded Space

Let us consider a case where all of the elements in some continuous slic...
research
07/18/2023

Multimodal LLMs for health grounded in individual-specific data

Foundation large language models (LLMs) have shown an impressive ability...

Please sign up or login with your details

Forgot password? Click here to reset