Small Sample Spaces for Gaussian Processes

03/04/2021
by   Toni Karvonen, et al.
0

It is known that the membership in a given reproducing kernel Hilbert space (RKHS) of the samples of a Gaussian process X is controlled by a certain nuclear dominance condition. However, it is less clear how to identify a "small" set of functions (not necessarily a vector space) that contains the samples. This article presents a general approach for identifying such sets. We use scaled RKHSs, which can be viewed as a generalisation of Hilbert scales, to define the sample support set as the largest set which is contained in every element of full measure under the law of X in the σ-algebra induced by the collection of scaled RKHS. This potentially non-measurable set is then shown to consist of those functions that can be expanded in terms of an orthonormal basis of the RKHS of the covariance kernel of X and have their squared basis coefficients bounded away from zero and infinity, a result suggested by the Karhunen-Loève theorem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2021

A brief note on understanding neural networks as Gaussian processes

As a generalization of the work in [Lee et al., 2017], this note briefly...
research
07/18/2022

Kullback-Leibler and Renyi divergences in reproducing kernel Hilbert space and Gaussian process settings

In this work, we present formulations for regularized Kullback-Leibler a...
research
01/04/2023

On using Reproducible Hilbert Spaces for the analysis of Replicated Spatial Point Processes

This paper focuses on the use of the theory of Reproducing Kernel Hilber...
research
10/23/2012

Further properties of Gaussian Reproducing Kernel Hilbert Spaces

We generalize the orthonormal basis for the Gaussian RKHS described in M...
research
07/14/2021

Spectrum Gaussian Processes Based On Tunable Basis Functions

Spectral approximation and variational inducing learning for the Gaussia...
research
03/15/2012

Super-Samples from Kernel Herding

We extend the herding algorithm to continuous spaces by using the kernel...

Please sign up or login with your details

Forgot password? Click here to reset