Evolutionary Hessian Learning: Forced Optimal Covariance Adaptive Learning (FOCAL)

by   Ofer M. Shir, et al.

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) has been the most successful Evolution Strategy at exploiting covariance information; it uses a form of Principle Component Analysis which, under certain conditions, is suggested to converge to the correct covariance matrix, formulated as the inverse of the mathematically well-defined Hessian matrix. However, in practice, there exist conditions where CMA-ES converges to the global optimum (accomplishing its primary goal) while it does not learn the true covariance matrix (missing an auxiliary objective), likely due to step-size deficiency. These circumstances can involve high-dimensional landscapes with large condition numbers. This paper introduces a novel technique entitled Forced Optimal Covariance Adaptive Learning (FOCAL), with the explicit goal of determining the Hessian at the global basin of attraction. It begins by introducing theoretical foundations to the inverse relationship between the learned covariance and the Hessian matrices. FOCAL is then introduced and demonstrated to retrieve the Hessian matrix with high fidelity on both model landscapes and experimental Quantum Control systems, which are observed to possess a non-separable, non-quadratic search landscape. The recovered Hessian forms are corroborated by physical knowledge of the systems. This study constitutes an example for Natural Computing successfully serving other branches of natural sciences, and introducing at the same time a powerful generic method for any high-dimensional continuous search seeking landscape information.


page 3

page 5

page 16

page 18

page 22

page 23

page 29


On the Theoretical Capacity of Evolution Strategies to Statistically Learn the Landscape Hessian

We study the theoretical capacity to statistically learn local landscape...

On the Covariance-Hessian Relation in Evolution Strategies

We consider Evolution Strategies operating only with isotropic Gaussian ...

Mirror Natural Evolution Strategies

The zeroth-order optimization has been widely used in machine learning a...

The Hessian Estimation Evolution Strategy

We present a novel black box optimization algorithm called Hessian Estim...

A Linear Time Natural Evolution Strategy for Non-Separable Functions

We present a novel Natural Evolution Strategy (NES) variant, the Rank-On...

Fast Approximation of Rotations and Hessians matrices

A new method to represent and approximate rotation matrices is introduce...

On-line Search History-assisted Restart Strategy for Covariance Matrix Adaptation Evolution Strategy

Restart strategy helps the covariance matrix adaptation evolution strate...

Please sign up or login with your details

Forgot password? Click here to reset