LSBN: A Large-Scale Bayesian Structure Learning Framework for Model Averaging

10/18/2012
by   Yang Lu, et al.
0

The motivation for this paper is to apply Bayesian structure learning using Model Averaging in large-scale networks. Currently, Bayesian model averaging algorithm is applicable to networks with only tens of variables, restrained by its super-exponential complexity. We present a novel framework, called LSBN(Large-Scale Bayesian Network), making it possible to handle networks with infinite size by following the principle of divide-and-conquer. The method of LSBN comprises three steps. In general, LSBN first performs the partition by using a second-order partition strategy, which achieves more robust results. LSBN conducts sampling and structure learning within each overlapping community after the community is isolated from other variables by Markov Blanket. Finally LSBN employs an efficient algorithm, to merge structures of overlapping communities into a whole. In comparison with other four state-of-art large-scale network structure learning algorithms such as ARACNE, PC, Greedy Search and MMHC, LSBN shows comparable results in five common benchmark datasets, evaluated by precision, recall and f-score. What's more, LSBN makes it possible to learn large-scale Bayesian structure by Model Averaging which used to be intractable. In summary, LSBN provides an scalable and parallel framework for the reconstruction of network structures. Besides, the complete information of overlapping communities serves as the byproduct, which could be used to mine meaningful clusters in biological networks, such as protein-protein-interaction network or gene regulatory network, as well as in social network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2012

LAGE: A Java Framework to reconstruct Gene Regulatory Networks from Large-Scale Continues Expression Data

LAGE is a systematic framework developed in Java. The motivation of LAGE...
research
08/27/2020

Learning All Credible Bayesian Network Structures for Model Averaging

A Bayesian network is a widely used probabilistic graphical model with a...
research
11/12/2018

Finding All Bayesian Network Structures within a Factor of Optimal

A Bayesian network is a widely used probabilistic graphical model with a...
research
11/09/2010

Using Model-based Overlapping Seed Expansion to detect highly overlapping community structure

As research into community finding in social networks progresses, there ...
research
05/30/2018

High-Quality Disjoint and Overlapping Community Structure in Large-Scale Complex Networks

In this paper, we propose an improved version of an agglomerative hierar...
research
04/18/2018

Entropic Spectral Learning in Large Scale Networks

We present a novel algorithm for learning the spectral density of large ...
research
03/22/2021

Partitioned hybrid learning of Bayesian network structures

We develop a novel hybrid method for Bayesian network structure learning...

Please sign up or login with your details

Forgot password? Click here to reset