Bayesian functional optimisation with shape prior

09/19/2018
by   Pratibha Vellanki, et al.
8

Real world experiments are expensive, and thus it is important to reach a target in minimum number of experiments. Experimental processes often involve control variables that changes over time. Such problems can be formulated as a functional optimisation problem. We develop a novel Bayesian optimisation framework for such functional optimisation of expensive black-box processes. We represent the control function using Bernstein polynomial basis and optimise in the coefficient space. We derive the theory and practice required to dynamically adjust the order of the polynomial degree, and show how prior information about shape can be integrated. We demonstrate the effectiveness of our approach for short polymer fibre design and optimising learning rate schedules for deep networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/27/2021

Bayesian Optimisation for Constrained Problems

Many real-world optimisation problems such as hyperparameter tuning in m...
research
04/25/2019

A Bayesian Approach for the Robust Optimisation of Expensive-To-Evaluate Functions

Many expensive black-box optimisation problems are sensitive to their in...
research
06/08/2023

Bayesian Optimisation of Functions on Graphs

The increasing availability of graph-structured data motivates the task ...
research
09/08/2020

Sequential Subspace Search for Functional Bayesian Optimization Incorporating Experimenter Intuition

We propose an algorithm for Bayesian functional optimisation - that is, ...
research
09/05/2023

Optimal Observation-Intervention Trade-Off in Optimisation Problems with Causal Structure

We consider the problem of optimising an expensive-to-evaluate grey-box ...
research
10/18/2022

Optimisation Generalisation in Networks of Neurons

The goal of this thesis is to develop the optimisation and generalisatio...
research
04/17/2020

What do you Mean? The Role of the Mean Function in Bayesian Optimisation

Bayesian optimisation is a popular approach for optimising expensive bla...

Please sign up or login with your details

Forgot password? Click here to reset