Infinite Shift-invariant Grouped Multi-task Learning for Gaussian Processes

03/05/2012
by   Yuyang Wang, et al.
0

Multi-task learning leverages shared information among data sets to improve the learning performance of individual tasks. The paper applies this framework for data where each task is a phase-shifted periodic time series. In particular, we develop a novel Bayesian nonparametric model capturing a mixture of Gaussian processes where each task is a sum of a group-specific function and a component capturing individual variation, in addition to each task being phase shifted. We develop an efficient em algorithm to learn the parameters of the model. As a special case we obtain the Gaussian mixture model and em algorithm for phased-shifted periodic time series. Furthermore, we extend the proposed model by using a Dirichlet Process prior and thereby leading to an infinite mixture model that is capable of doing automatic model selection. A Variational Bayesian approach is developed for inference in this model. Experiments in regression, classification and class discovery demonstrate the performance of the proposed models using both synthetic data and real-world time series data from astrophysics. Our methods are particularly useful when the time series are sparsely and non-synchronously sampled.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2019

Multi-task Learning in Deep Gaussian Processes with Multi-kernel Layers

We present a multi-task learning formulation for Deep Gaussian processes...
research
01/27/2020

Bayesian nonparametric shared multi-sequence time series segmentation

In this paper, we introduce a method for segmenting time series data usi...
research
06/19/2017

Infinite Mixture Model of Markov Chains

We propose a Bayesian nonparametric mixture model for prediction- and in...
research
03/28/2017

Discovering Explainable Latent Covariance Structure for Multiple Time Series

Analyzing time series data is important to predict future events and cha...
research
08/29/2023

Heterogeneous Multi-Task Gaussian Cox Processes

This paper presents a novel extension of multi-task Gaussian Cox process...
research
10/28/2021

Coresets for Time Series Clustering

We study the problem of constructing coresets for clustering problems wi...
research
02/09/2019

Low-pass filtering as Bayesian inference

We propose a Bayesian nonparametric method for low-pass filtering that c...

Please sign up or login with your details

Forgot password? Click here to reset