Monotonic Gaussian Process Flow

05/30/2019
by   Ivan Ustyuzhaninov, et al.
0

We propose a new framework of imposing monotonicity constraints in a Bayesian non-parametric setting. Our approach is based on numerical solutions of stochastic differential equations [Hedge, 2019]. We derive a non-parametric model of monotonic functions that allows for interpretable priors and principled quantification of hierarchical uncertainty. We demonstrate the efficacy of the proposed model by providing competitive results to other probabilistic models of monotonic functions on a number of benchmark functions. In addition, we consider the utility of a monotonic constraint in hierarchical probabilistic models, such as deep Gaussian processes. These typically suffer difficulties in modelling and propagating uncertainties throughout the hierarchy that can lead to hidden layers collapsing to point estimates. We address this by constraining hidden layers to be monotonic and present novel procedures for learning and inference that maintain uncertainty. We illustrate the capacity and versatility of the proposed framework on the task of temporal alignment of time-series data where it is beneficial to preserve the uncertainty in the temporal warpings.

READ FULL TEXT
research
10/20/2022

Uncertainty Disentanglement with Non-stationary Heteroscedastic Gaussian Processes for Active Learning

Gaussian processes are Bayesian non-parametric models used in many areas...
research
10/29/2021

Aligned Multi-Task Gaussian Process

Multi-task learning requires accurate identification of the correlations...
research
04/14/2017

Non-parametric Estimation of Stochastic Differential Equations with Sparse Gaussian Processes

The application of Stochastic Differential Equations (SDEs) to the analy...
research
02/15/2018

Constraining the Dynamics of Deep Probabilistic Models

We introduce a novel generative formulation of deep probabilistic models...
research
10/04/2022

A Probabilistic Model for Aircraft in Climb using Monotonic Functional Gaussian Process Emulators

Ensuring vertical separation is a key means of maintaining safe separati...
research
03/07/2018

Gaussian Process Latent Variable Alignment Learning

We present a model that can automatically learn alignments between high-...
research
09/19/2017

Deep Lattice Networks and Partial Monotonic Functions

We propose learning deep models that are monotonic with respect to a use...

Please sign up or login with your details

Forgot password? Click here to reset