Speeding Up Private Distributed Matrix Multiplication via Bivariate Polynomial Codes

02/16/2021
by   Burak Hasircioglu, et al.
0

We consider the problem of private distributed matrix multiplication under limited resources. Coded computation has been shown to be an effective solution in distributed matrix multiplication, both providing privacy against the workers and boosting the computation speed by efficiently mitigating stragglers. In this work, we propose the use of recently-introduced bivariate polynomial codes to further speed up private distributed matrix multiplication by exploiting the partial work done by the stragglers rather than completely ignoring them. We show that the proposed approach significantly reduces the average computation time of private distributed matrix multiplication compared to its competitors in the literature, while improving the upload communication cost and the workers' storage efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/14/2021

Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication

We consider the problem of secure distributed matrix multiplication. Cod...
research
05/13/2023

Fully Private Grouped Matrix Multiplication with Colluding Workers

In this paper, we present a novel variation of the coded matrix multipli...
research
01/20/2020

Bivariate Polynomial Coding for Exploiting Stragglers in Heterogeneous Coded Computing Systems

Polynomial coding has been proposed as a solution to the straggler mitig...
research
05/30/2021

2.5-dimensional distributed model training

Data parallelism does a good job in speeding up the training. However, w...
research
01/15/2020

Entangled Polynomial Codes for Secure, Private, and Batch Distributed Matrix Multiplication: Breaking the ”Cubic” Barrier

In distributed matrix multiplication, a common scenario is to assign eac...
research
11/05/2020

Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication

Large-scale machine learning and data mining methods routinely distribut...
research
02/22/2022

Distilled Neural Networks for Efficient Learning to Rank

Recent studies in Learning to Rank have shown the possibility to effecti...

Please sign up or login with your details

Forgot password? Click here to reset