
-
IDEAL: Inexact DEcentralized Accelerated Augmented Lagrangian Method
We introduce a framework for designing primal methods under the decentra...
read it
-
Stochastic Optimization with Non-stationary Noise
We investigate stochastic optimization problems under relaxed assumption...
read it
-
On Complexity of Finding Stationary Points of Nonsmooth Nonconvex Functions
We provide the first non-asymptotic analysis for finding stationary poin...
read it
-
On the Complexity of Minimizing Convex Finite Sums Without Using the Indices of the Individual Functions
Recent advances in randomized incremental methods for minimizing L-smoot...
read it
-
ResNet with one-neuron hidden layers is a Universal Approximator
We demonstrate that a very deep ResNet with stacked modules with one neu...
read it
-
Catalyst Acceleration for First-order Convex Optimization: from Theory to Practice
We introduce a generic scheme for accelerating gradient-based optimizati...
read it
-
Catalyst Acceleration for Gradient-Based Non-Convex Optimization
We introduce a generic scheme to solve nonconvex optimization problems u...
read it
-
A Generic Quasi-Newton Algorithm for Faster Gradient-Based Optimization
We propose a generic approach to accelerate gradient-based optimization ...
read it