research
∙
09/17/2023
Global Convergence of SGD For Logistic Loss on Two Layer Neural Nets
In this note, we demonstrate a first-of-its-kind provable convergence of...
share
research
∙
08/11/2023
Size Lowerbounds for Deep Operator Networks
Deep Operator Networks are an increasingly popular paradigm for solving ...
research
∙
10/20/2022
Global Convergence of SGD On Two Layer Neural Nets
In this note we demonstrate provable convergence of SGD to the global mi...
research
∙
05/23/2022
Capacity Bounds for the DeepONet Method of Solving Differential Equations
In recent times machine learning methods have made significant advances ...
research
∙
04/26/2022
An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate
A particular direction of recent advance about stochastic deep-learning ...
research
∙
11/01/2021
Investigating the locality of neural network training dynamics
A fundamental quest in the theory of deep-learning is to understand the ...
research
∙
04/28/2021
A Study of the Mathematics of Deep Learning
"Deep Learning"/"Deep Neural Nets" is a technological marvel that is now...
research
∙
05/08/2020
A Study of Neural Training with Non-Gradient and Noise Assisted Gradient Methods
In this work we demonstrate provable guarantees on the training of depth...
research
∙
05/04/2020
Guarantees on learning depth-2 neural networks under a data-poisoning attack
In recent times many state-of-the-art machine learning models have been ...
research
∙
07/18/2018
Convergence guarantees for RMSProp and ADAM in non-convex optimization and their comparison to Nesterov acceleration on autoencoders
RMSProp and ADAM continue to be extremely popular algorithms for trainin...
research
∙
11/08/2017
Lower bounds over Boolean inputs for deep neural networks with ReLU gates
Motivated by the resurgence of neural networks in being able to solve co...
research
∙
08/12/2017
Sparse Coding and Autoencoders
In "Dictionary Learning" one tries to recover incoherent matrices A^* ∈R...
research
∙
11/04/2016