research
∙
03/15/2022
Surrogate Gap Minimization Improves Sharpness-Aware Training
The recently proposed Sharpness-Aware Minimization (SAM) improves genera...
share
research
∙
12/19/2021
FedNI: Federated Graph Learning with Network Inpainting for Population-Based Disease Prediction
Graph Convolutional Neural Networks (GCNs) are widely used for graph ana...
research
∙
10/11/2021
Momentum Centering and Asynchronous Update for Adaptive Gradient Methods
We propose ACProp (Asynchronous-centering-Prop), an adaptive optimizer w...
research
∙
10/15/2020
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Most popular optimizers for deep learning can be broadly categorized as ...
research
∙
06/03/2020
Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODE
Neural ordinary differential equations (NODEs) have recently attracted i...
research
∙
01/16/2020
