The trace norm constrained matrix-variate Gaussian process for multitask bipartite ranking

02/11/2013
by   Oluwasanmi Koyejo, et al.
0

We propose a novel hierarchical model for multitask bipartite ranking. The proposed approach combines a matrix-variate Gaussian process with a generative model for task-wise bipartite ranking. In addition, we employ a novel trace constrained variational inference approach to impose low rank structure on the posterior matrix-variate Gaussian process. The resulting posterior covariance function is derived in closed form, and the posterior mean function is the solution to a matrix-variate regression with a novel spectral elastic net regularizer. Further, we show that variational inference for the trace constrained matrix-variate Gaussian process combined with maximum likelihood parameter estimation for the bipartite ranking model is jointly convex. Our motivating application is the prioritization of candidate disease genes. The goal of this task is to aid the identification of unobserved associations between human genes and diseases using a small set of observed associations as well as kernels induced by gene-gene interaction networks and disease ontologies. Our experimental results illustrate the performance of the proposed model on real world datasets. Moreover, we find that the resulting low rank solution improves the computational scalability of training and testing as compared to baseline models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2014

A Constrained Matrix-Variate Gaussian Process for Transposable Data

Transposable data represents interactions among two sets of entities, an...
research
09/26/2013

Constrained Bayesian Inference for Low Rank Multitask Learning

We present a novel approach for constrained Bayesian inference. Unlike c...
research
08/29/2023

Multi-Response Heteroscedastic Gaussian Process Models and Their Inference

Despite the widespread utilization of Gaussian process models for versat...
research
06/05/2020

A conditional one-output likelihood formulation for multitask Gaussian processes

Multitask Gaussian processes (MTGP) are the Gaussian process (GP) framew...
research
06/11/2022

Gradient Boosting Performs Low-Rank Gaussian Process Inference

This paper shows that gradient boosting based on symmetric decision tree...
research
09/15/2020

Interpolating the Trace of the Inverse of Matrix 𝐀 + t 𝐁

We develop heuristic interpolation methods for the function t ↦trace( (𝐀...
research
03/14/2022

Modelling Non-Smooth Signals with Complex Spectral Structure

The Gaussian Process Convolution Model (GPCM; Tobar et al., 2015a) is a ...

Please sign up or login with your details

Forgot password? Click here to reset