Covariance Function Pre-Training with m-Kernels for Accelerated Bayesian Optimisation

02/15/2018
by   Alistair Shilton, et al.
0

The paper presents a novel approach to direct covariance function learning for Bayesian optimisation, with particular emphasis on experimental design problems where an existing corpus of condensed knowledge is present. The method presented borrows techniques from reproducing kernel Banach space theory (specifically m-kernels) and leverages them to convert (or re-weight) existing covariance functions into new, problem-specific covariance functions. The key advantage of this approach is that rather than relying on the user to manually select (with some hyperparameter tuning and experimentation) an appropriate covariance function it constructs the covariance function to specifically match the problem at hand. The technique is demonstrated on two real-world problems - specifically alloy design and carbon-fibre manufacturing - as well as a selected test function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2018

Kernel Pre-Training in Feature Space via m-Kernels

This paper presents a novel approach to kernel tuning. The method presen...
research
05/27/2021

Bayesian Optimisation for Constrained Problems

Many real-world optimisation problems such as hyperparameter tuning in m...
research
06/30/2011

Kernels for Vector-Valued Functions: a Review

Kernel methods are among the most popular techniques in machine learning...
research
10/16/2020

The Ridgelet Prior: A Covariance Function Approach to Prior Specification for Bayesian Neural Networks

Bayesian neural networks attempt to combine the strong predictive perfor...
research
10/29/2014

Efficient optimisation of structures using tabu search

This paper presents a novel approach to the optimisation of structures u...
research
12/20/2018

On the positivity and magnitudes of Bayesian quadrature weights

This article reviews and studies the properties of Bayesian quadrature w...
research
07/30/2022

Doubly Deformable Aggregation of Covariance Matrices for Few-shot Segmentation

Training semantic segmentation models with few annotated samples has gre...

Please sign up or login with your details

Forgot password? Click here to reset