On the Optimal Recovery Threshold of Coded Matrix Multiplication

01/31/2018
by   Sanghamitra Dutta, et al.
0

We provide novel coded computation strategies for distributed matrix-matrix products that outperform the recent "Polynomial code" constructions in recovery threshold, i.e., the required number of successful workers. When m-th fraction of each matrix can be stored in each worker node, polynomial codes require m^2 successful workers, while our MatDot codes only require 2m-1 successful workers, albeit at a higher communication cost from each worker to the fusion node. Further, we propose "PolyDot" coding that interpolates between Polynomial codes and MatDot codes. Finally, we demonstrate an application of MatDot codes to multiplying multiple (> 2) matrices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/28/2022

Folded Polynomial Codes for Coded Distributed AA^⊤-Type Matrix Multiplication

In this paper, due to the important value in practical applications, we ...
research
11/06/2018

Erasure coding for distributed matrix multiplication for matrices with bounded entries

Distributed matrix multiplication is widely used in several scientific d...
research
11/30/2020

Parity-Checked Strassen Algorithm

To multiply astronomic matrices using parallel workers subject to stragg...
research
01/23/2018

Straggler Mitigation in Distributed Matrix Multiplication: Fundamental Limits and Optimal Coding

We consider the problem of massive matrix multiplication, which underlie...
research
11/28/2018

An Application of Storage-Optimal MatDot Codes for Coded Matrix Multiplication: Fast k-Nearest Neighbors Estimation

We propose a novel application of coded computing to the problem of the ...
research
05/24/2018

Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding

We consider the problem of training a least-squares regression model on ...
research
12/16/2020

Incentive Mechanism Design for Distributed Coded Machine Learning

A distributed machine learning platform needs to recruit many heterogene...

Please sign up or login with your details

Forgot password? Click here to reset