Hybrid Kronecker Product Decomposition and Approximation

12/06/2019
by   Chencheng Cai, et al.
0

Discovering the underlying low dimensional structure of high dimensional data has attracted a significant amount of researches recently and has shown to have a wide range of applications. As an effective dimension reduction tool, singular value decomposition is often used to analyze high dimensional matrices, which are traditionally assumed to have a low rank matrix approximation. In this paper, we propose a new approach. We assume a high dimensional matrix can be approximated by a sum of a small number of Kronecker products of matrices with potentially different configurations, named as a hybird Kronecker outer Product Approximation (hKoPA). It provides an extremely flexible way of dimension reduction compared to the low-rank matrix approximation. Challenges arise in estimating a hKoPA when the configurations of component Kronecker products are different or unknown. We propose an estimation procedure when the set of configurations are given and a joint configuration determination and component estimation procedure when the configurations are unknown. Specifically, a least squares backfitting algorithm is used when the configuration is given. When the configuration is unknown, an iterative greedy algorithm is used. Both simulation and real image examples show that the proposed algorithms have promising performances. The hybrid Kronecker product approximation may have potentially wider applications in low dimensional representation of high dimensional data

READ FULL TEXT

page 15

page 16

research
09/22/2021

Weighted Low Rank Matrix Approximation and Acceleration

Low-rank matrix approximation is one of the central concepts in machine ...
research
12/05/2019

KoPA: Automated Kronecker Product Approximation

We consider matrix approximation induced by the Kronecker product decomp...
research
07/30/2021

A Scalable Approach to Estimating the Rank of High-Dimensional Data

A key challenge to performing effective analyses of high-dimensional dat...
research
11/26/2019

Stable Matrix Completion using Properly Configured Kronecker Product Decomposition

Matrix completion problems are the problems of recovering missing entrie...
research
08/16/2016

A Geometrical Approach to Topic Model Estimation

In the probabilistic topic models, the quantity of interest---a low-rank...
research
01/18/2019

Fast High-Dimensional Kernel Filtering

The bilateral and nonlocal means filters are instances of kernel-based f...
research
07/21/2020

Spectral estimation from simulations via sketching

Sketching is a stochastic dimension reduction method that preserves geom...

Please sign up or login with your details

Forgot password? Click here to reset