Coded Sparse Matrix Multiplication

02/09/2018
by   Sinong Wang, et al.
0

In a large-scale and distributed matrix multiplication problem C=A^B, where C∈R^r× t, the coded computation plays an important role to effectively deal with "stragglers" (distributed computations that may get delayed due to few slow or faulty processors). However, existing coded schemes could destroy the significant sparsity that exists in large-scale machine learning problems, and could result in much higher computation overhead, i.e., O(rt) decoding time. In this paper, we develop a new coded computation strategy, we call sparse code, which achieves near optimal recovery threshold, low computation overhead, and linear decoding time O(nnz(C)). We implement our scheme and demonstrate the advantage of the approach over both uncoded and current fastest coded strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2019

Random Sampling for Distributed Coded Matrix Multiplication

Matrix multiplication is a fundamental building block for large scale co...
research
04/25/2018

Fundamental Limits of Coded Linear Transform

In large scale distributed linear transform problems, coded computation ...
research
04/15/2019

Distributed Matrix Multiplication Using Speed Adaptive Coding

While performing distributed computations in today's cloud-based platfor...
research
01/16/2019

Coded Matrix Multiplication on a Group-Based Model

Coded distributed computing has been considered as a promising technique...
research
07/20/2019

Cuboid Partitioning for Hierarchical Coded Matrix Multiplication

Coded matrix multiplication is a technique to enable straggler-resistant...
research
07/03/2018

Private Information Retrieval in Asynchronous Coded Computation

We firstly consider fully asynchronous coded computation for matrix mult...
research
09/01/2023

Randomized Polar Codes for Anytime Distributed Machine Learning

We present a novel distributed computing framework that is robust to slo...

Please sign up or login with your details

Forgot password? Click here to reset