A mixed-categorical correlation kernel for Gaussian process

11/15/2022
by   P. Saves, et al.
0

Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian process (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estimation of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surrogate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.

READ FULL TEXT
research
03/21/2011

Additive Kernels for Gaussian Process Modeling

Gaussian Process (GP) models are often used as mathematical approximatio...
research
10/06/2020

Gaussian Process Models with Low-Rank Correlation Matrices for Both Continuous and Categorical Inputs

We introduce a method that uses low-rank approximations of cross-correla...
research
02/25/2021

Mixed Variable Bayesian Optimization with Frequency Modulated Kernels

The sample efficiency of Bayesian optimization(BO) is often boosted by G...
research
05/23/2023

SMT 2.0: A Surrogate Modeling Toolbox with a focus on Hierarchical and Mixed Variables Gaussian Processes

The Surrogate Modeling Toolbox (SMT) is an open-source Python package th...
research
06/15/2021

Kernel Identification Through Transformers

Kernel selection plays a central role in determining the performance of ...
research
09/21/2022

Gaussian Process Hydrodynamics

We present a Gaussian Process (GP) approach (Gaussian Process Hydrodynam...
research
10/18/2016

AutoGP: Exploring the Capabilities and Limitations of Gaussian Process Models

We investigate the capabilities and limitations of Gaussian process mode...

Please sign up or login with your details

Forgot password? Click here to reset