Straggler-Resilient and Communication-Efficient Distributed Iterative Linear Solver

06/15/2018
by   Farzin Haddadpour, et al.
0

We propose a novel distributed iterative linear inverse solver method. Our method, PolyLin, has significantly lower communication cost, both in terms of number of rounds as well as number of bits, in comparison with the state of the art at the cost of higher computational complexity and storage. Our algorithm also has a built-in resilience to straggling and faulty computation nodes. We develop a natural variant of our main algorithm that trades off communication cost for computational complexity. Our method is inspired by ideas in error correcting codes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2018

On the Interactive Communication Cost of the Distributed Nearest Lattice Point Problem

We consider the problem of distributed computation of the nearest lattic...
research
04/09/2020

Dithered backprop: A sparse and quantized backpropagation algorithm for more efficient deep neural network training

Deep Neural Networks are successful but highly computationally expensive...
research
01/31/2022

Fast Distributed k-Means with a Small Number of Rounds

We propose a new algorithm for k-means clustering in a distributed setti...
research
01/28/2022

Positive Rate Binary Interactive Error Correcting Codes Resilient to >1/2 Adversarial Erasures

An interactive error correcting code (𝗂𝖤𝖢𝖢) is an interactive protocol w...
research
12/19/2019

Scalable Resilience Against Node Failures for Communication-Hiding Preconditioned Conjugate Gradient and Conjugate Residual Methods

The observed and expected continued growth in the number of nodes in lar...
research
06/09/2022

A Resilient Distributed Boosting Algorithm

Given a learning task where the data is distributed among several partie...
research
01/24/2023

GRAND-EDGE: A Universal, Jamming-resilient Algorithm with Error-and-Erasure Decoding

Random jammers that overpower transmitted signals are a practical concer...

Please sign up or login with your details

Forgot password? Click here to reset