Optimizing Closed-Loop Performance with Data from Similar Systems: A Bayesian Meta-Learning Approach

10/31/2022
by   Ankush Chakrabarty, et al.
0

Bayesian optimization (BO) has demonstrated potential for optimizing control performance in data-limited settings, especially for systems with unknown dynamics or unmodeled performance objectives. The BO algorithm efficiently trades-off exploration and exploitation by leveraging uncertainty estimates using surrogate models. These surrogates are usually learned using data collected from the target dynamical system to be optimized. Intuitively, the convergence rate of BO is better for surrogate models that can accurately predict the target system performance. In classical BO, initial surrogate models are constructed using very limited data points, and therefore rarely yield accurate predictions of system performance. In this paper, we propose the use of meta-learning to generate an initial surrogate model based on data collected from performance optimization tasks performed on a variety of systems that are different to the target system. To this end, we employ deep kernel networks (DKNs) which are simple to train and which comprise encoded Gaussian process models that integrate seamlessly with classical BO. The effectiveness of our proposed DKN-BO approach for speeding up control system performance optimization is demonstrated using a well-studied nonlinear system with unknown dynamics and an unmodeled performance function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/07/2023

MALIBO: Meta-learning for Likelihood-free Bayesian Optimization

Bayesian optimization (BO) is a popular method to optimize costly black-...
research
08/13/2020

Meta Learning MPC using Finite-Dimensional Gaussian Process Approximations

Data availability has dramatically increased in recent years, driving mo...
research
11/14/2022

Meta-Learning of Neural State-Space Models Using Data From Similar Systems

Deep neural state-space models (SSMs) provide a powerful tool for modeli...
research
05/12/2020

Safe Learning-based Observers for Unknown Nonlinear Systems using Bayesian Optimization

Data generated from dynamical systems with unknown dynamics enable the l...
research
01/19/2021

Few-Shot Bayesian Optimization with Deep Kernel Surrogates

Hyperparameter optimization (HPO) is a central pillar in the automation ...
research
09/12/2019

Closed-loop Model Selection for Kernel-based Models using Bayesian Optimization

Kernel-based nonparametric models have become very attractive for model-...
research
09/07/2022

SmOOD: Smoothness-based Out-of-Distribution Detection Approach for Surrogate Neural Networks in Aircraft Design

Aircraft industry is constantly striving for more efficient design optim...

Please sign up or login with your details

Forgot password? Click here to reset