Riemannian preconditioned algorithms for tensor completion via tensor ring decomposition

02/28/2023
by   Bin Gao, et al.
0

We propose Riemannian preconditioned algorithms for the tensor completion problem via tensor ring decomposition. A new Riemannian metric is developed on the product space of the mode-2 unfolding matrices of the core tensors in tensor ring decomposition. The construction of this metric aims to approximate the Hessian of the cost function by its diagonal blocks, paving the way for various Riemannian optimization methods. Specifically, we propose the Riemannian gradient descent and Riemannian conjugate gradient algorithms. We prove that both algorithms globally converge to a stationary point. In the implementation, we exploit the tensor structure and design an economical procedure to avoid large matrix formulation and computation in gradients, which significantly reduces the computational cost. Numerical experiments on various synthetic and real-world datasets – movie ratings, hyperspectral images, and high-dimensional functions – suggest that the proposed algorithms are more efficient and have better reconstruction ability than other candidates.

READ FULL TEXT

page 14

page 16

page 17

research
01/26/2021

New Riemannian preconditioned algorithms for tensor completion via polyadic decomposition

We propose new Riemannian preconditioned algorithms for low-rank tensor ...
research
06/15/2023

Optimization on product manifolds under a preconditioned metric

Since optimization on Riemannian manifolds relies on the chosen metric, ...
research
04/07/2015

Heterogeneous Tensor Decomposition for Clustering via Manifold Optimization

Tensors or multiarray data are generalizations of matrices. Tensor clust...
research
01/05/2018

Tensor Train decomposition on TensorFlow (T3F)

Tensor Train decomposition is used across many branches of machine learn...
research
11/12/2016

Riemannian Tensor Completion with Side Information

By restricting the iterate on a nonlinear manifold, the recently propose...
research
01/07/2019

Randomized Tensor Ring Decomposition and Its Application to Large-scale Data Reconstruction

Dimensionality reduction is an essential technique for multi-way large-s...
research
08/27/2021

Provable Tensor-Train Format Tensor Completion by Riemannian Optimization

The tensor train (TT) format enjoys appealing advantages in handling str...

Please sign up or login with your details

Forgot password? Click here to reset