All-to-All Encode in Synchronous Systems

05/10/2022
by   Canran Wang, et al.
0

We define all-to-all encode, a collective communication operation serving as a primitive in decentralized computation and storage systems. Consider a scenario where every processor initially has a data packet and requires a linear combination of all data packets; the linear combinations are distinct from one processor to another, and are specified by a generator matrix of an error correcting code. We use a linear network model, in which processors transmit linear combinations of their data and previously received packets, and adopt a standard synchronous system setting to analyze its communication cost. We provide a universal algorithm which computes any matrix in this model by only varying intermediate coefficients, and prove its optimality. When the generator matrix is of the Vandermonde or Lagrange type, we further optimize the communication efficiency of the proposed algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/11/2020

Measuring time delay in path MTU discovery in transmitting a packet in IPv4 and IPv6 network

Path MTU Discovery (PMTUD) was initially designed for Internet protocol ...
research
05/29/2018

Neural Network Aided Decoding for Physical-Layer Network Coding Random Access

Hinging on ideas from physical-layer network coding, some promising prop...
research
09/26/2021

A Doubly-pipelined, Dual-root Reduction-to-all Algorithm and Implementation

We discuss a simple, binary tree-based algorithm for the collective allr...
research
04/13/2018

Erasure Correcting Codes by Using Shift Operation and Exclusive OR

This paper proposes an erasure correcting code and its systematic form f...
research
06/11/2019

Optimizing Pipelined Computation and Communication for Latency-Constrained Edge Learning

Consider a device that is connected to an edge processor via a communica...
research
10/21/2019

A King in every two consecutive tournaments

We think of a tournament T=([n], E) as a communication network where in ...
research
05/17/2018

Fast reinforcement learning for decentralized MAC optimization

In this paper, we propose a novel decentralized framework for optimizing...

Please sign up or login with your details

Forgot password? Click here to reset