Aligned Multi-Task Gaussian Process

10/29/2021
by   Olga Mikheeva, et al.
0

Multi-task learning requires accurate identification of the correlations between tasks. In real-world time-series, tasks are rarely perfectly temporally aligned; traditional multi-task models do not account for this and subsequent errors in correlation estimation will result in poor predictive performance and uncertainty quantification. We introduce a method that automatically accounts for temporal misalignment in a unified generative model that improves predictive performance. Our method uses Gaussian processes (GPs) to model the correlations both within and between the tasks. Building on the previous work by Kazlauskaiteet al. [2019], we include a separate monotonic warp of the input data to model temporal misalignment. In contrast to previous work, we formulate a lower bound that accounts for uncertainty in both the estimates of the warping process and the underlying functions. Also, our new take on a monotonic stochastic process, with efficient path-wise sampling for the warp functions, allows us to perform full Bayesian inference in the model rather than MAP estimates. Missing data experiments, on synthetic and real time-series, demonstrate the advantages of accounting for misalignments (vs standard unaligned method) as well as modelling the uncertainty in the warping process(vs baseline MAP alignment approach).

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 7

page 14

page 15

05/30/2019

Monotonic Gaussian Process Flow

We propose a new framework of imposing monotonicity constraints in a Bay...
10/28/2021

Multi-Task Processes

Neural Processes (NPs) consider a task as a function realized from a sto...
02/21/2018

Emulating dynamic non-linear simulators using Gaussian processes

In this paper, we examine the emulation of non-linear deterministic comp...
07/21/2020

MAGMA: Inference and Prediction with Multi-Task Gaussian Processes

We investigate the problem of multiple time series forecasting, with the...
10/24/2018

Scalable Gaussian Processes on Discrete Domains

Kernel methods on discrete domains have shown great promise for many cha...
11/16/2020

Cluster-Specific Predictions with Multi-Task Gaussian Processes

A model involving Gaussian processes (GPs) is introduced to simultaneous...
11/26/2018

Sequence Alignment with Dirichlet Process Mixtures

We present a probabilistic model for unsupervised alignment of high-dime...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.