Bayesian Robust Tensor Factorization for Incomplete Multiway Data

10/09/2014
by   Qibin Zhao, et al.
0

We propose a generative model for robust tensor factorization in the presence of both missing data and outliers. The objective is to explicitly infer the underlying low-CP-rank tensor capturing the global information and a sparse tensor capturing the local information (also considered as outliers), thus providing the robust predictive distribution over missing entries. The low-CP-rank tensor is modeled by multilinear interactions between multiple latent factors on which the column sparsity is enforced by a hierarchical prior, while the sparse tensor is modeled by a hierarchical view of Student-t distribution that associates an individual hyperparameter with each element independently. For model learning, we develop an efficient closed-form variational inference under a fully Bayesian treatment, which can effectively prevent the overfitting problem and scales linearly with data size. In contrast to existing related works, our method can perform model selection automatically and implicitly without need of tuning parameters. More specifically, it can discover the groundtruth of CP rank and automatically adapt the sparsity inducing priors to various types of outliers. In addition, the tradeoff between the low-rank approximation and the sparse representation can be optimized in the sense of maximum model evidence. The extensive experiments and comparisons with many state-of-the-art algorithms on both synthetic and real-world datasets demonstrate the superiorities of our method from several perspectives.

READ FULL TEXT

page 9

page 10

page 12

page 13

research
01/25/2014

Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination

CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powe...
research
05/10/2015

Bayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion

Tucker decomposition is the cornerstone of modern machine learning on te...
research
02/27/2022

Bayesian Robust Tensor Ring Model for Incomplete Multiway Data

Low-rank tensor completion aims to recover missing entries from the obse...
research
09/06/2018

Variational Bayesian Inference for Robust Streaming Tensor Factorization and Completion

Streaming tensor factorization is a powerful tool for processing high-vo...
research
11/30/2012

Approximate Rank-Detecting Factorization of Low-Rank Tensors

We present an algorithm, AROFAC2, which detects the (CP-)rank of a degre...
research
02/16/2021

Robust Factorization of Real-world Tensor Streams with Patterns, Missing Values, and Outliers

Consider multiple seasonal time series being collected in real-time, in ...
research
01/08/2021

A Bayesian Approach to Block-Term Tensor Decomposition Model Selection and Computation

The so-called block-term decomposition (BTD) tensor model, especially in...

Please sign up or login with your details

Forgot password? Click here to reset