Block subsampled randomized Hadamard transform for low-rank approximation on distributed architectures

10/20/2022
by   Oleg Balabanov, et al.
0

This article introduces a novel structured random matrix composed blockwise from subsampled randomized Hadamard transforms (SRHTs). The block SRHT is expected to outperform well-known dimension reduction maps, including SRHT and Gaussian matrices, on distributed architectures with not too many cores compared to the dimension. We prove that a block SRHT with enough rows is an oblivious subspace embedding, i.e., an approximate isometry for an arbitrary low-dimensional subspace with high probability. Our estimate of the required number of rows is similar to that of the standard SRHT. This suggests that the two transforms should provide the same accuracy of approximation in the algorithms. The block SRHT can be readily incorporated into randomized methods, for instance to compute a low-rank approximation of a large-scale matrix. For completeness, we revisit some common randomized approaches for this problem such as Randomized Singular Value Decomposition and Nyström approximation, with a discussion of their accuracy and implementation on distributed architectures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2023

Randomized low-rank approximation of parameter-dependent matrices

This work considers the low-rank approximation of a matrix A(t) dependin...
research
08/11/2020

Random Projections and Dimension Reduction

This paper, broadly speaking, covers the use of randomness in two main a...
research
08/10/2023

Randomized low-rank approximations beyond Gaussian random matrices

This paper expands the analysis of randomized low-rank approximation bey...
research
04/13/2015

Adaptive Randomized Dimension Reduction on Massive Data

The scalability of statistical estimators is of increasing importance in...
research
05/04/2021

Deterministic matrix sketches for low-rank compression of high-dimensional simulation data

Matrices arising in scientific applications frequently admit linear low-...
research
08/22/2019

Block Randomized Optimization for Adaptive Hypergraph Learning

The high-order relations between the content in social media sharing pla...
research
09/09/2023

A subspace constrained randomized Kaczmarz method for structure or external knowledge exploitation

We study a subspace constrained version of the randomized Kaczmarz algor...

Please sign up or login with your details

Forgot password? Click here to reset