
Acceleration via Fractal Learning Rate Schedules
When balancing the practical tradeoffs of iterative methods for largesc...
read it

A Regret Minimization Approach to Iterative Learning Control
We consider the setting of iterative learning control, or modelbased po...
read it

Deluca – A Differentiable Control Library: Environments, Methods, and Benchmarking
We present an opensource library of natively differentiable physics and...
read it

Machine Learning for Mechanical Ventilation Control
We consider the problem of controlling an invasive mechanical ventilator...
read it

Stochastic Optimization with Laggard Data Pipelines
Stateoftheart optimization is steadily shifting towards massively par...
read it

Disentangling Adaptive Gradient Methods from Learning Rates
We investigate several confounding factors in the evaluation of optimiza...
read it

A Deep Conditioning Treatment of Neural Networks
We study the role of depth in training randomly initialized overparamete...
read it

Logarithmic Regret for Online Control
We study optimal regret bounds for control in linear dynamical systems u...
read it

Boosting for Dynamical Systems
We propose a framework of boosting for learning and control in environme...
read it

Design and Development of Underwater Vehicle: ANAHITA
Anahita is an autonomous underwater vehicle which is currently being dev...
read it

Online Control with Adversarial Disturbances
We study the control of a linear dynamical system with adversarial distu...
read it

Extreme Tensoring for LowMemory Preconditioning
Stateoftheart models are now trained with billions of parameters, rea...
read it

The Case for FullMatrix Adaptive Regularization
Adaptive regularization methods come in diagonal and fullmatrix variant...
read it

cpSGD: Communicationefficient and differentiallyprivate distributed SGD
Distributed stochastic gradient descent is an important subroutine in di...
read it

Effective Dimension of Expconcave Optimization
We investigate the role of the effective (a.k.a. statistical) dimension ...
read it

Leverage Score Sampling for Faster Accelerated Regression and ERM
Given a matrix A∈R^n× d and a vector b ∈R^d, we show how to compute an ϵ...
read it

Lower Bounds for HigherOrder Convex Optimization
Stateoftheart methods in convex and nonconvex optimization employ hi...
read it

The Price of Differential Privacy For Online Learning
We design differentially private algorithms for the problem of online li...
read it

Finding Approximate Local Minima Faster than Gradient Descent
We design a nonconvex secondorder optimization algorithm that is guara...
read it

SecondOrder Stochastic Optimization for Machine Learning in Linear Time
Firstorder stochastic methods are the stateoftheart in largescale m...
read it

Multisection in the Stochastic Block Model using Semidefinite Programming
We consider the problem of identifying underlying communitylike structu...
read it
Naman Agarwal
is this you? claim profile