Random Sampling for Distributed Coded Matrix Multiplication

05/16/2019
by   Wei-Ting Chang, et al.
0

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix multiplication, that are robust to stragglers (i.e., machines that may perform slower computations). In many scenarios, instead of exact computation, approximate matrix multiplication, i.e., allowing for a tolerable error is also sufficient. Such approximate schemes make use of randomization techniques to speed up the computation process. In this paper, we initiate the study of approximate coded matrix multiplication, and investigate the joint synergies offered by randomization and coding. Specifically, we propose two coded randomized sampling schemes that use (a) codes to achieve a desired recovery threshold and (b) random sampling to obtain approximation of the matrix multiplication. Tradeoffs between the recovery threshold and approximation error obtained through random sampling are investigated for a class of coded matrix multiplication schemes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2021

ε-Approximate Coded Matrix Multiplication is Nearly Twice as Efficient as Exact Multiplication

We study coded distributed matrix multiplication from an approximate rec...
research
02/09/2018

Coded Sparse Matrix Multiplication

In a large-scale and distributed matrix multiplication problem C=A^B, wh...
research
05/11/2021

Optimal Sampling Algorithms for Block Matrix Multiplication

In this paper, we investigate the randomized algorithms for block matrix...
research
01/10/2022

Successive Approximation Coding for Distributed Matrix Multiplication

Coded distributed computing was recently introduced to mitigate the effe...
research
09/19/2023

Distributed Matrix Multiplication with a Smaller Recovery Threshold through Modulo-based Approaches

This paper considers the problem of calculating the matrix multiplicatio...
research
11/05/2020

Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication

Large-scale machine learning and data mining methods routinely distribut...
research
02/07/2022

Locally Random Alloy Codes with Channel Coding Theorems for Distributed Matrix Multiplication

Matrix multiplication is a fundamental operation in machine learning and...

Please sign up or login with your details

Forgot password? Click here to reset