research
∙
04/24/2023
Renate: A Library for Real-World Continual Learning
Continual learning enables the incremental training of machine learning ...
share
research
∙
07/14/2022
PASHA: Efficient HPO with Progressive Resource Allocation
Hyperparameter optimization (HPO) and neural architecture search (NAS) a...
research
∙
03/28/2022
Gradient-Matching Coresets for Rehearsal-Based Continual Learning
The goal of continual learning (CL) is to efficiently update a machine l...
research
∙
12/09/2021
Gradient-matching coresets for continual learning
We devise a coreset selection method based on the idea of gradient match...
research
∙
11/09/2020
Self-Tuning Stochastic Optimization with Curvature-Aware Gradient Filtering
Standard first-order stochastic optimization algorithms base their updat...
research
∙
05/29/2019
Limitations of the Empirical Fisher Approximation
Natural gradient descent, which preconditions a gradient descent update ...
research
∙
03/13/2019
DeepOBS: A Deep Learning Optimizer Benchmark Suite
Because the choice and tuning of the optimizer affects the speed, and ul...
research
∙
05/22/2017
Follow the Signs for Robust Stochastic Optimization
Stochastic noise on gradients is now a common feature in machine learnin...
research
∙
03/28/2017
Early Stopping without a Validation Set
Early stopping is a widely used technique to prevent poor generalization...
research
∙
12/15/2016