A Survey on Fault-tolerance in Distributed Optimization and Machine Learning

06/16/2021
by   Shuo Liu, et al.
0

The robustness of distributed optimization is an emerging field of study, motivated by various applications of distributed optimization including distributed machine learning, distributed sensing, and swarm robotics. With the rapid expansion of the scale of distributed systems, resilient distributed algorithms for optimization are needed, in order to mitigate system failures, communication issues, or even malicious attacks. This survey investigates the current state of fault-tolerance research in distributed optimization, and aims to provide an overview of the existing studies on both fault-tolerant distributed optimization theories and applicable algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2022

Byzantine Fault Tolerance in Distributed Machine Learning : a Survey

Byzantine Fault Tolerance (BFT) is among the most challenging problems i...
research
06/30/2019

Network-accelerated Distributed Machine Learning Using MLFabric

Existing distributed machine learning (DML) systems focus on improving t...
research
08/24/2017

Results of the Survey: Failures in Robotics and Intelligent Systems

In January 2015 we distributed an online survey about failures in roboti...
research
08/07/2023

The FIDS Theorems: Tensions between Multinode and Multicore Performance in Transactional Systems

Traditionally, distributed and parallel transactional systems have been ...
research
04/08/2014

Virtual Prototyping and Distributed Control for Solar Array with Distributed Multilevel Inverter

In this paper, we present the virtual prototyping of a solar array with ...
research
09/15/2023

Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templates

Oobleck enables resilient distributed training of large DNN models with ...
research
10/18/2021

SPON: Enabling Resilient Inter-Ledgers Payments with an Intrusion-Tolerant Overlay

Payment systems are a critical component of everyday life in our society...

Please sign up or login with your details

Forgot password? Click here to reset