
-
Advances in Asynchronous Parallel and Distributed Optimization
Motivated by large-scale optimization problems arising in the context of...
read it
-
Communication Efficient Sparsification for Large Scale Machine Learning
The increasing scale of distributed learning problems necessitates the d...
read it
-
Convergence of a Stochastic Gradient Method with Momentum for Nonsmooth Nonconvex Optimization
Stochastic gradient methods with momentum are widely used in application...
read it
-
Anderson Acceleration of Proximal Gradient Methods
Anderson acceleration is a well-established and simple technique for spe...
read it
-
Efficient Stochastic Programming in Julia
We present StochasticPrograms.jl, a user-friendly and powerful open-sour...
read it
-
Noisy Accelerated Power Method for Eigenproblems with Applications
This paper introduces an efficient algorithm for finding the dominant ge...
read it
-
Curvature-Exploiting Acceleration of Elastic Net Computations
This paper introduces an efficient second-order method for solving the e...
read it
-
Harnessing the Power of Serverless Runtimes for Large-Scale Optimization
The event-driven and elastic nature of serverless runtimes makes them a ...
read it
-
POLO: a POLicy-based Optimization library
We present POLO --- a C++ library for large-scale parallel optimization ...
read it
-
The Convergence of Sparsified Gradient Methods
Distributed training of massive machine learning models, in particular d...
read it
-
Distributed learning with compressed gradients
Asynchronous computation and gradient compression have emerged as two ke...
read it
-
Continuous-time Value Function Approximation in Reproducing Kernel Hilbert Spaces
Motivated by the success of reinforcement learning (RL) for discrete-tim...
read it
-
Analysis and Implementation of an Asynchronous Optimization Algorithm for the Parameter Server
This paper presents an asynchronous incremental aggregated gradient algo...
read it
-
An Asynchronous Mini-Batch Algorithm for Regularized Stochastic Optimization
Mini-batch optimization has proven to be a powerful paradigm for large-s...
read it
-
Ergodic Mirror Descent
We generalize stochastic subgradient descent methods to situations in wh...
read it