Distributed Accelerated Projection-Based Consensus Decomposition

06/17/2023
by   Wiktor Maj, et al.
0

With the development of machine learning and Big Data, the concepts of linear and non-linear optimization techniques are becoming increasingly valuable for many quantitative disciplines. Problems of that nature are typically solved using distinctive optimization algorithms, iterative methods, or heuristics. A new variant of the Accelerated Projection-Based Consensus (APC) iterative method is proposed, which is faster than its classical version while handling large sparse matrices in distributed settings. The algorithm is proposed, and its description and implementation in a high-level programming language are presented. Convergence tests measuring acceleration factors based on real-world datasets are done, and their results are promising. The results of this research can be used as an alternative to solving numerical optimization problems.

READ FULL TEXT
research
09/26/2019

Randomized Iterative Methods for Linear Systems: Momentum, Inexactness and Gossip

In the era of big data, one of the key challenges is the development of ...
research
03/09/2023

Gauges and Accelerated Optimization over Smooth and/or Strongly Convex Sets

We consider feasibility and constrained optimization problems defined ov...
research
05/03/2021

EBIC.JL – an Efficient Implementation of Evolutionary Biclustering Algorithm in Julia

Biclustering is a data mining technique which searches for local pattern...
research
10/02/2020

Distributed Proximal Splitting Algorithms with Rates and Acceleration

We analyze several generic proximal splitting algorithms well suited for...
research
11/11/2022

Fast model averaging via buffered states and first-order accelerated optimization algorithms

In this letter, we study the problem of accelerating reaching average co...
research
09/18/2021

An Accelerated Variance-Reduced Conditional Gradient Sliding Algorithm for First-order and Zeroth-order Optimization

The conditional gradient algorithm (also known as the Frank-Wolfe algori...
research
03/14/2021

Transient growth of accelerated first-order methods for strongly convex optimization problems

Optimization algorithms are increasingly being used in applications with...

Please sign up or login with your details

Forgot password? Click here to reset