Optimal Bayesian Transfer Learning

01/02/2018
by   Alireza Karbalayghareh, et al.
0

Transfer learning has recently attracted significant research attention, as it simultaneously learns from different source domains, which have plenty of labeled data, and transfers the relevant knowledge to the target domain with limited labeled data to improve the prediction performance. We propose a Bayesian transfer learning framework where the source and target domains are related through the joint prior density of the model parameters. The modeling of joint prior densities enables better understanding of the "transferability" between domains. We define a joint Wishart density for the precision matrices of the Gaussian feature-label distributions in the source and target domains to act like a bridge that transfers the useful information of the source domain to help classification in the target domain by improving the target posteriors. Using several theorems in multivariate statistics, the posteriors and posterior predictive densities are derived in closed forms with hypergeometric functions of matrix argument, leading to our novel closed-form and fast Optimal Bayesian Transfer Learning (OBTL) classifier. Experimental results on both synthetic and real-world benchmark data confirm the superb performance of the OBTL compared to the other state-of-the-art transfer learning and domain adaptation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2017

Multi-Relevance Transfer Learning

Transfer learning aims to faciliate learning tasks in a label-scarce tar...
research
07/31/2017

Transfer Learning with Label Noise

Transfer learning aims to improve learning in the target domain with lim...
research
09/04/2018

Parameter Transfer Extreme Learning Machine based on Projective Model

Recent years, transfer learning has attracted much attention in the comm...
research
07/06/2018

Towards more Reliable Transfer Learning

Multi-source transfer learning has been proven effective when within-tar...
research
09/05/2021

Robust Importance Sampling for Error Estimation in the Context of Optimal Bayesian Transfer Learning

Classification has been a major task for building intelligent systems as...
research
08/27/2021

A Framework for Supervised Heterogeneous Transfer Learning using Dynamic Distribution Adaptation and Manifold Regularization

Transfer learning aims to learn classifiers for a target domain by trans...
research
01/20/2020

Heterogeneous Transfer Learning in Ensemble Clustering

This work proposes an ensemble clustering method using transfer learning...

Please sign up or login with your details

Forgot password? Click here to reset