Advanced Stationary and Non-Stationary Kernel Designs for Domain-Aware Gaussian Processes

02/05/2021
by   Marcus M. Noack, et al.
22

Gaussian process regression is a widely-applied method for function approximation and uncertainty quantification. The technique has gained popularity recently in the machine learning community due to its robustness and interpretability. The mathematical methods we discuss in this paper are an extension of the Gaussian-process framework. We are proposing advanced kernel designs that only allow for functions with certain desirable characteristics to be elements of the reproducing kernel Hilbert space (RKHS) that underlies all kernel methods and serves as the sample space for Gaussian process regression. These desirable characteristics reflect the underlying physics; two obvious examples are symmetry and periodicity constraints. In addition, non-stationary kernel designs can be defined in the same framework to yield flexible multi-task Gaussian processes. We will show the impact of advanced kernel designs on Gaussian processes using several synthetic and two scientific data sets. The results show that including domain knowledge, communicated through advanced kernel designs, has a significant impact on the accuracy and relevance of the function approximation.

READ FULL TEXT

page 7

page 8

page 9

page 12

page 14

page 16

page 17

research
05/30/2023

Non-stationary Gaussian Process Surrogates

We provide a survey of non-stationary surrogate models which utilize Gau...
research
01/26/2022

A Kernel-Based Approach for Modelling Gaussian Processes with Functional Information

Gaussian processes are among the most useful tools in modeling continuou...
research
07/02/2015

Anomaly Detection and Removal Using Non-Stationary Gaussian Processes

This paper proposes a novel Gaussian process approach to fault removal i...
research
06/02/2017

Multiple Kernel Learning and Automatic Subspace Relevance Determination for High-dimensional Neuroimaging Data

Alzheimer's disease is a major cause of dementia. Its diagnosis requires...
research
09/11/2022

Kernel Learning for Explainable Climate Science

The Upper Indus Basin, Himalayas provides water for 270 million people a...
research
07/06/2018

Gaussian Processes and Kernel Methods: A Review on Connections and Equivalences

This paper is an attempt to bridge the conceptual gaps between researche...
research
12/25/2019

Scalable Gaussian Process Regression for Kernels with a Non-Stationary Phase

The application of Gaussian processes (GPs) to large data sets is limite...

Please sign up or login with your details

Forgot password? Click here to reset