High-dimensional additive Gaussian processes under monotonicity constraints

05/17/2022
by   Andrés F. López-Lopera, et al.
0

We introduce an additive Gaussian process framework accounting for monotonicity constraints and scalable to high dimensions. Our contributions are threefold. First, we show that our framework enables to satisfy the constraints everywhere in the input space. We also show that more general componentwise linear inequality constraints can be handled similarly, such as componentwise convexity. Second, we propose the additive MaxMod algorithm for sequential dimension reduction. By sequentially maximizing a squared-norm criterion, MaxMod identifies the active input dimensions and refines the most important ones. This criterion can be computed explicitly at a linear cost. Finally, we provide open-source codes for our full framework. We demonstrate the performance and scalability of the methodology in several synthetic examples with hundreds of dimensions under monotonicity constraints as well as on a real-world flood application.

READ FULL TEXT

page 3

page 7

research
09/09/2020

Sequential construction and dimension reduction of Gaussian processes under inequality constraints

Accounting for inequality constraints, such as boundedness, monotonicity...
research
12/19/2011

Additive Gaussian Processes

We introduce a Gaussian process model of functions which are additive. A...
research
10/20/2017

Finite-dimensional Gaussian approximation with linear inequality constraints

Introducing inequality constraints in Gaussian process (GP) models can l...
research
03/05/2015

High Dimensional Bayesian Optimisation and Bandits via Additive Models

Bayesian Optimisation (BO) is a technique used in optimising a D-dimensi...
research
01/30/2020

Rank and Kernel of F_p-Additive Generalised Hadamard Codes

A subset of a vector space F_q^n is K-additive if it is a linear space o...
research
01/15/2019

Approximating Gaussian Process Emulators with Linear Inequality Constraints and Noisy Observations via MC and MCMC

Adding inequality constraints (e.g. boundedness, monotonicity, convexity...
research
02/05/2020

Linearly Constrained Neural Networks

We present an approach to designing neural network based models that wil...

Please sign up or login with your details

Forgot password? Click here to reset