Factored LT and Factored Raptor Codes for Large-Scale Distributed Matrix Multiplication

07/25/2019
by   Asit Kumar Pradhan, et al.
0

We propose two coding schemes for distributed matrix multiplication in the presence of stragglers. These coding schemes are adaptations of LT codes and Raptor codes to distributed matrix multiplication and are termed factored LT (FLT) codes and factored Raptor (FR) codes. Empirically, we show that FLT codes have near-optimal recovery thresholds when the number of worker nodes is very large, and that FR codes have excellent recovery thresholds while the number of worker nodes is moderately large. FLT and FR codes have better recovery thresholds when compared to Product codes and they are expected to have better numerical stability when compared to Polynomial codes, while they can also be decoded with a low-complexity decoding algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2019

Random Khatri-Rao-Product Codes for Numerically-Stable Distributed Matrix Multiplication

We propose a class of codes called random Khatri-Rao-Product (RKRP) code...
research
01/25/2019

Distributed Matrix-Vector Multiplication: A Convolutional Coding Approach

Distributed computing systems are well-known to suffer from the problem ...
research
02/07/2022

Locally Random Alloy Codes with Channel Coding Theorems for Distributed Matrix Multiplication

Matrix multiplication is a fundamental operation in machine learning and...
research
04/27/2018

Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication

Large-scale machine learning and data mining applications require comput...
research
05/05/2021

ε-Approximate Coded Matrix Multiplication is Nearly Twice as Efficient as Exact Multiplication

We study coded distributed matrix multiplication from an approximate rec...
research
05/05/2023

Modular Polynomial Codes for Secure and Robust Distributed Matrix Multiplication

We present Modular Polynomial (MP) Codes for Secure Distributed Matrix M...
research
05/12/2022

Sparse Random Khatri-Rao Product Codes for Distributed Matrix Multiplication

We introduce two generalizations to the paradigm of using Random Khatri-...

Please sign up or login with your details

Forgot password? Click here to reset