-
Lifelong Learning with Sketched Structural Regularization
Preventing catastrophic forgetting while continually learning new tasks ...
04/17/2021 ∙ by Haoran Li, et al. ∙
5
∙
share
read it
-
Benign Overfitting of Constant-Stepsize SGD for Linear Regression
There is an increasing realization that algorithmic inductive biases are...
03/23/2021 ∙ by Difan Zou, et al. ∙
9
∙
share
read it
-
Accommodating Picky Customers: Regret Bound and Exploration Complexity for Multi-Objective Reinforcement Learning
In this paper we consider multi-objective reinforcement learning where t...
11/25/2020 ∙ by Jingfeng Wu, et al. ∙
3
∙
share
read it
-
Direction Matters: On the Implicit Regularization Effect of Stochastic Gradient Descent with Moderate Learning Rate
Understanding the algorithmic regularization effect of stochastic gradie...
11/04/2020 ∙ by Jingfeng Wu, et al. ∙
14
∙
share
read it
-
Obtaining Adjustable Regularization for Free via Iterate Averaging
Regularization for optimization is a crucial technique to avoid overfitt...
08/15/2020 ∙ by Jingfeng Wu, et al. ∙
0
∙
share
read it
-
The Multiplicative Noise in Stochastic Gradient Descent: Data-Dependent Regularization, Continuous and Discrete Approximation
The randomness in Stochastic Gradient Descent (SGD) is considered to pla...
06/18/2019 ∙ by Jingfeng Wu, et al. ∙
0
∙
share
read it
-
Tangent-Normal Adversarial Regularization for Semi-supervised Learning
The ever-increasing size of modern datasets combined with the difficulty...
08/18/2018 ∙ by Bing Yu, et al. ∙
0
∙
share
read it
-
The Regularization Effects of Anisotropic Noise in Stochastic Gradient Descent
Understanding the generalization of deep learning has raised lots of con...
03/01/2018 ∙ by Zhanxing Zhu, et al. ∙
0
∙
share
read it
