-
Domain-independent Dominance of Adaptive Methods
From a simplified analysis of adaptive methods, we derive AvaGrad, a new...
12/04/2019 ∙ by Pedro Savarese, et al. ∙
6
∙
share
read it
-
How do infinite width bounded norm networks look in function space?
We consider the question of what functions can be captured by ReLU netwo...
02/13/2019 ∙ by Pedro Savarese, et al. ∙
0
∙
share
read it
-
Learning Implicitly Recurrent CNNs Through Parameter Sharing
We introduce a parameter sharing scheme, in which different layers of a ...
02/26/2019 ∙ by Pedro Savarese, et al. ∙
0
∙
share
read it
-
On the Convergence of AdaBound and its Connection to SGD
Adaptive gradient methods such as Adam have gained extreme popularity du...
08/13/2019 ∙ by Pedro Savarese, et al. ∙
0
∙
share
read it
-
Building a Massive Corpus for Named Entity Recognition using Free Open Data Sources
With the recent progress in machine learning, boosted by techniques such...
08/13/2019 ∙ by Daniel Specht Menezes, et al. ∙
0
∙
share
read it
-
Winning the Lottery with Continuous Sparsification
The Lottery Ticket Hypothesis from Frankle Carbin (2019) conjectures...
12/10/2019 ∙ by Pedro Savarese, et al. ∙
0
∙
share
read it
-
Kernel and Rich Regimes in Overparametrized Models
A recent line of work studies overparametrized neural networks in the "k...
02/20/2020 ∙ by Blake Woodworth, et al. ∙
0
∙
share
read it
