Multi-task Learning in Deep Gaussian Processes with Multi-kernel Layers

05/29/2019
by   Ayman Boustati, et al.
0

We present a multi-task learning formulation for Deep Gaussian processes (DGPs), describing a multi-kernel architecture for DGP layers. The proposed model is a non-linear mixture of latent Gaussian processes (GPs) with components shared between the tasks, in addition to separate task-specific components. Our formulation allows for learning complex relationships between tasks. We benchmark our model on three real-world datasets showing empirically that our formulation is able to improve the learning performance and transfer information between the tasks, outperforming state-of-the-art GP-based single-task learning and multi-task learning models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/15/2012

A Convex Formulation for Learning Task Relationships in Multi-Task Learning

Multi-task learning is a learning paradigm which seeks to improve the ge...
research
06/22/2019

Multi-task Learning for Aggregated Data using Gaussian Processes

Aggregated data is commonplace in areas such as epidemiology and demogra...
research
03/05/2012

Infinite Shift-invariant Grouped Multi-task Learning for Gaussian Processes

Multi-task learning leverages shared information among data sets to impr...
research
09/22/2017

Ensemble Multi-task Gaussian Process Regression with Multiple Latent Processes

Multi-task/Multi-output learning seeks to exploit correlation among task...
research
11/28/2012

Nonparametric Bayesian Mixed-effect Model: a Sparse Gaussian Process Approach

Multi-task learning models using Gaussian processes (GP) have been devel...
research
10/19/2020

Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems

Recent advances in Deep Gaussian Processes (DGPs) show the potential to ...
research
06/20/2023

Time-Varying Transition Matrices with Multi-task Gaussian Processes

In this paper, we present a kernel-based, multi-task Gaussian Process (G...

Please sign up or login with your details

Forgot password? Click here to reset