Analog Lagrange Coded Computing

08/19/2020
by   Mahdi Soleymani, et al.
0

A distributed computing scenario is considered, where the computational power of a set of worker nodes is used to perform a certain computation task over a dataset that is dispersed among the workers. Lagrange coded computing (LCC), proposed by Yu et al., leverages the well-known Lagrange polynomial to perform polynomial evaluation of the dataset in such a scenario in an efficient parallel fashion while keeping the privacy of data amidst possible collusion of workers. This solution relies on quantizing the data into a finite field, so that Shamir's secret sharing, as one of its main building blocks, can be employed. Such a solution, however, is not properly scalable with the size of dataset, mainly due to computation overflows. To address such a critical issue, we propose a novel extension of LCC to the analog domain, referred to as analog LCC (ALCC). All the operations in the proposed ALCC protocol are done over the infinite fields of R/C but for practical implementations floating-point numbers are used. We characterize the privacy of data in ALCC, against any subset of colluding workers up to a certain size, in terms of the distinguishing security (DS) and the mutual information security (MIS) metrics. Also, the accuracy of outcome is characterized in a practical setting assuming operations are performed using floating-point numbers. Consequently, a fundamental trade-off between the accuracy of the outcome of ALCC and its privacy level is observed and is numerically evaluated. Moreover, we implement the proposed scheme to perform matrix-matrix multiplication over a batch of matrices. It is observed that ALCC is superior compared to the state-of-the-art LCC, implemented using fixed-point numbers, assuming both schemes use an equal number of bits to represent data symbols.

READ FULL TEXT
research
07/17/2020

Privacy-Preserving Distributed Learning in the Analog Domain

We consider the critical problem of distributed learning over data while...
research
02/25/2022

Compressed Matrix Computations

Frugal computing is becoming an important topic for environmental reason...
research
08/12/2019

Secure Coded Multi-Party Computation for Massive Matrix Operations

In this paper, we consider a secure multi-party computation problem (MPC...
research
09/22/2021

Numerically Stable Binary Coded Computations

This paper addresses the gradient coding and coded matrix multiplication...
research
08/11/2023

Sparsity and Privacy in Secret Sharing: A Fundamental Trade-Off

This work investigates the design of sparse secret sharing schemes that ...
research
03/03/2022

Distributed Matrix-Vector Multiplication with Sparsity and Privacy Guarantees

We consider the problem of designing a coding scheme that allows both sp...
research
11/30/2020

Parity-Checked Strassen Algorithm

To multiply astronomic matrices using parallel workers subject to stragg...

Please sign up or login with your details

Forgot password? Click here to reset