Generalized Lagrange Coded Computing: A Flexible Computation-Communication Tradeoff

04/24/2022
by   Jinbao Zhu, et al.
0

We consider the problem of evaluating arbitrary multivariate polynomials over a massive dataset, in a distributed computing system with a master node and multiple worker nodes. Generalized Lagrange Coded Computing (GLCC) codes are proposed to provide robustness against stragglers who do not return computation results in time, adversarial workers who deliberately modify results for their benefit, and information-theoretic security of the dataset amidst possible collusion of workers. GLCC codes are constructed by first partitioning the dataset into multiple groups, and then encoding the dataset using carefully designed interpolation polynomials, such that interference computation results across groups can be eliminated at the master. Particularly, GLCC codes include the state-of-the-art Lagrange Coded Computing (LCC) codes as a special case, and achieve a more flexible tradeoff between communication and computation overheads in optimizing system efficiency.

READ FULL TEXT
research
12/14/2022

Coded Computation of Multiple Functions

We consider the problem of evaluating arbitrary multivariate polynomials...
research
02/01/2019

Private Secure Coded Computation

We introduce a variation of coded computation that ensures data security...
research
01/27/2021

List-Decodable Coded Computing: Breaking the Adversarial Toleration Barrier

We consider the problem of coded computing where a computational task is...
research
10/29/2019

The Tradeoff Between Coverage and Computation in Wireless Networks

We consider a distributed edge computing scenario consisting of several ...
research
05/11/2023

Probabilistic Group Testing in Distributed Computing with Attacked Workers

The problem of distributed matrix-vector product is considered, where th...
research
02/06/2020

A locality-based approach for coded computation

Modern distributed computation infrastructures are often plagued by unav...
research
02/07/2018

Minimizing Latency for Secure Coded Computing Using Secret Sharing via Staircase Codes

We consider the setting of a Master server, M, who possesses confidentia...

Please sign up or login with your details

Forgot password? Click here to reset