Polar Coded Distributed Matrix Multiplication

01/21/2019
by   Burak Bartan, et al.
0

We propose a polar coding mechanism for distributed matrix multiplication. Polar codes provably achieve channel capacity and have the advantage of low encoding and decoding complexity. These aspects of polar codes enable a scalable scheme for hundreds of compute nodes in coded computation. We analyze the polarization phenomenon in the context of run times of compute nodes and characterize polarizing matrices over real numbers. We design a sequential decoder specifically for polar codes in erasure channels with real-valued input and outputs. The proposed coded computation scheme is implemented for a serverless computing platform and numerical results are provided. Numerical results illustrate that proposed coded computation scheme achieves significant speed-ups. Finally, experiments are conducted where the performance of the proposed coded computation technique is tested in solving a least squares problem using gradient descent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/01/2023

Randomized Polar Codes for Anytime Distributed Machine Learning

We present a novel distributed computing framework that is robust to slo...
research
06/26/2018

Hierarchical Coded Computation

Coded computation is a method to mitigate "stragglers" in distributed co...
research
05/08/2021

Coded Alternating Least Squares for Straggler Mitigation in Distributed Recommendations

Matrix factorization is an important representation learning algorithm, ...
research
06/24/2019

Coded Distributed Computing: Performance Limits and Code Designs

We consider the problem of coded distributed computing where a large lin...
research
05/15/2018

Coded Iterative Computing using Substitute Decoding

In this paper, we propose a new coded computing technique called "substi...
research
05/13/2021

Variable Coded Batch Matrix Multiplication

In this paper, we introduce the Variable Coded Distributed Batch Matrix ...
research
04/25/2019

Array BP-XOR Codes for Parallel Matrix Multiplication using Hierarchical Computing

This study presents a novel coded computation technique for parallel mat...

Please sign up or login with your details

Forgot password? Click here to reset