research
∙
02/24/2018
Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari
Evolution Strategies (ES) have recently been demonstrated to be a viable...
share
research
∙
11/14/2017
Fixing Weight Decay Regularization in Adam
We note that common implementations of adaptive gradient algorithms, suc...
research
∙
07/27/2017
A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets
The original ImageNet dataset is a popular large-scale benchmark for tra...
research
∙
05/18/2017
Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization
The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a popula...
research
∙
08/13/2016
SGDR: Stochastic Gradient Descent with Warm Restarts
Restart techniques are common in gradient-free optimization to deal with...
research
∙
05/09/2016
Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)
We propose a multi-objective optimization algorithm aimed at achieving g...
research
∙
04/25/2016
CMA-ES for Hyperparameter Optimization of Deep Neural Networks
Hyperparameters of deep neural networks are often optimized by grid sear...
research
∙
11/19/2015
Online Batch Selection for Faster Training of Neural Networks
Deep neural networks are commonly trained using stochastic non-convex op...
research
∙
11/01/2015
LM-CMA: an Alternative to L-BFGS for Large Scale Black-box Optimization
The limited memory BFGS method (L-BFGS) of Liu and Nocedal (1989) is oft...
research
∙
06/10/2014
Maximum Likelihood-based Online Adaptation of Hyper-parameters in CMA-ES
The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely a...
research
∙
04/21/2014
A Computationally Efficient Limited Memory CMA-ES for Large Scale Optimization
We propose a computationally efficient limited memory Covariance Matrix ...
research
∙
08/12/2013
KL-based Control of the Learning Schedule for Surrogate Black-Box Optimization
This paper investigates the control of an ML component within the Covari...
research
∙
07/01/2012
Alternative Restart Strategies for CMA-ES
This paper focuses on the restart strategy of CMA-ES on multi-modal func...
research
∙
04/24/2012
Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed
In this paper, we study the performance of IPOP-saACM-ES and BIPOP-saACM...
research
∙
04/24/2012
Black-box optimization benchmarking of IPOP-saACM-ES on the BBOB-2012 noisy testbed
In this paper, we study the performance of IPOP-saACM-ES, recently propo...
research
∙
04/11/2012