Bayesian Discovery of Multiple Bayesian Networks via Transfer Learning

07/09/2013
by   Diane Oyen, et al.
0

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from limited data is difficult, therefore transfer learning can improve the robustness of learned networks by leveraging data from related tasks. Existing transfer learning algorithms for Bayesian network structure learning give a single maximum a posteriori estimate of network models. Yet, many other models may be equally likely, and so a more informative result is provided by Bayesian structure discovery. Bayesian structure discovery algorithms estimate posterior probabilities of structural features, such as edges. We present transfer learning for Bayesian structure discovery which allows us to explore the shared and unique structural features among related tasks. Efficient computation requires that our transfer learning objective factors into local calculations, which we prove is given by a broad class of transfer biases. Theoretically, we show the efficiency of our approach. Empirically, we show that compared to single task learning, transfer learning is better able to positively identify true edges. We apply the method to whole-brain neuroimaging data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2012

Advances in exact Bayesian structure discovery in Bayesian networks

We consider a Bayesian method for learning the Bayesian network structur...
research
04/12/2017

Beyond Uniform Priors in Bayesian Network Structure Learning

Bayesian network structure learning is often performed in a Bayesian set...
research
01/31/2022

Deep Learning Macroeconomics

Limited datasets and complex nonlinear relationships are among the chall...
research
11/12/2013

A PAC-Bayesian bound for Lifelong Learning

Transfer learning has received a lot of attention in the machine learnin...
research
05/09/2012

Exact Structure Discovery in Bayesian Networks with Less Space

The fastest known exact algorithms for scorebased structure discovery in...
research
10/17/2022

Conditional Neural Processes for Molecules

Neural processes (NPs) are models for transfer learning with properties ...
research
12/02/2019

Implicit Priors for Knowledge Sharing in Bayesian Neural Networks

Bayesian interpretations of neural network have a long history, dating b...

Please sign up or login with your details

Forgot password? Click here to reset