Gaussian Process Models with Low-Rank Correlation Matrices for Both Continuous and Categorical Inputs

10/06/2020
by   Dominik Kirchhoff, et al.
0

We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method – called Low-Rank Correlation (LRC) – offers the ability to flexibly adapt the number of parameters to the problem at hand by choosing an appropriate rank of the approximation. Furthermore, we present a systematic approach of defining test functions that can be used for assessing the accuracy of models or optimization methods that are concerned with both continuous and categorical inputs. We compare LRC to existing approaches of modeling the cross-correlation matrix. It turns out that the new approach performs well in terms of estimation of cross-correlations and response surface prediction. Therefore, LRC is a flexible and useful addition to existing methods, especially for increasing numbers of combinations of levels of the categorical inputs.

READ FULL TEXT

page 10

page 11

page 12

page 13

page 15

research
11/15/2022

A mixed-categorical correlation kernel for Gaussian process

Recently, there has been a growing interest for mixed-categorical meta-m...
research
09/14/2020

Continuous dictionaries meet low-rank tensor approximations

In this short paper we bridge two seemingly unrelated sparse approximati...
research
06/20/2019

Bayesian Optimisation over Multiple Continuous and Categorical Inputs

Efficient optimisation of black-box problems that comprise both continuo...
research
03/13/2018

Low-Rank Boolean Matrix Approximation by Integer Programming

Low-rank approximations of data matrices are an important dimensionality...
research
12/01/2020

Field-wise Learning for Multi-field Categorical Data

We propose a new method for learning with multi-field categorical data. ...
research
03/28/2022

A new Nested Cross Approximation

In this article, we present a new Nested Cross Approximation (NCA), for ...
research
02/07/2018

Group kernels for Gaussian process metamodels with categorical inputs

Gaussian processes (GP) are widely used as a metamodel for emulating tim...

Please sign up or login with your details

Forgot password? Click here to reset