MLCTR: A Fast Scalable Coupled Tensor Completion Based on Multi-Layer Non-Linear Matrix Factorization

09/04/2021
by   Ajim Uddin, et al.
0

Firms earning prediction plays a vital role in investment decisions, dividends expectation, and share price. It often involves multiple tensor-compatible datasets with non-linear multi-way relationships, spatiotemporal structures, and different levels of sparsity. Current non-linear tensor completion algorithms tend to learn noisy embedding and incur overfitting. This paper focuses on the embedding learning aspect of the tensor completion problem and proposes a new multi-layer neural network architecture for tensor factorization and completion (MLCTR). The network architecture entails multiple advantages: a series of low-rank matrix factorizations (MF) building blocks to minimize overfitting, interleaved transfer functions in each layer for non-linearity, and by-pass connections to reduce the gradient diminishing problem and increase the depths of neural networks. Furthermore, the model employs Stochastic Gradient Descent(SGD) based optimization for fast convergence in training. Our algorithm is highly efficient for imputing missing values in the EPS data. Experiments confirm that our strategy of incorporating non-linearity in factor matrices demonstrates impressive performance in embedding learning and end-to-end tensor models, and outperforms approaches with non-linearity in the phase of reconstructing tensors from factor matrices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2022

JULIA: Joint Multi-linear and Nonlinear Identification for Tensor Completion

Tensor completion aims at imputing missing entries from a partially obse...
research
10/05/2020

Non-Linear Self-Interference Cancellation via Tensor Completion

Non-linear self-interference (SI) cancellation constitutes a fundamental...
research
04/10/2021

Hierarchical Prior Regularized Matrix Factorization for Image Completion

The recent low-rank prior based models solve the tensor completion probl...
research
05/01/2018

Compact Factorization of Matrices Using Generalized Round-Rank

Matrix factorization is a well-studied task in machine learning for comp...
research
10/06/2019

Enabling Distributed-Memory Tensor Completion in Python using New Sparse Tensor Kernels

Tensor computations are increasingly prevalent numerical techniques in d...
research
10/26/2014

A Ternary Non-Commutative Latent Factor Model for Scalable Three-Way Real Tensor Completion

Motivated by large-scale Collaborative-Filtering applications, we presen...
research
11/04/2021

A Fast Parallel Tensor Decomposition with Optimal Stochastic Gradient Descent: an Application in Structural Damage Identification

Structural Health Monitoring (SHM) provides an economic approach which a...

Please sign up or login with your details

Forgot password? Click here to reset