Coded Computation of Multiple Functions

12/14/2022
by   Wilton Kim, et al.
0

We consider the problem of evaluating arbitrary multivariate polynomials over several massive datasets in a distributed computing system with a single master node and multiple worker nodes. We focus on the general case when each multivariate polynomial is evaluated over its dataset and propose a generalization of the Lagrange Coded Computing framework (Yu et al. 2019) to provide robustness against stragglers who do not respond in time, adversarial workers who respond with wrong computation and information-theoretic security of dataset against colluding workers. Our scheme introduces a small computation overhead which results in a reduction in download cost and also offers comparable resistance to stragglers over existing solutions.

READ FULL TEXT
research
04/24/2022

Generalized Lagrange Coded Computing: A Flexible Computation-Communication Tradeoff

We consider the problem of evaluating arbitrary multivariate polynomials...
research
06/04/2018

Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy

We consider a distributed computing scenario that involves computations ...
research
02/06/2020

A locality-based approach for coded computation

Modern distributed computation infrastructures are often plagued by unav...
research
05/14/2019

Coded Distributed Tracking

We consider the problem of tracking the state of a process that evolves ...
research
01/23/2020

Coded Computing for Boolean Functions

The growing size of modern datasets necessitates a massive computation i...
research
01/05/2018

Near Optimal Coded Data Shuffling for Distributed Learning

Data shuffling between distributed cluster of nodes is one of the critic...
research
07/10/2023

Coded Distributed Image Classification

In this paper, we present a coded computation (CC) scheme for distribute...

Please sign up or login with your details

Forgot password? Click here to reset