A Tractable Fully Bayesian Method for the Stochastic Block Model

02/06/2016
by   Kohei Hayashi, et al.
0

The stochastic block model (SBM) is a generative model revealing macroscopic structures in graphs. Bayesian methods are used for (i) cluster assignment inference and (ii) model selection for the number of clusters. In this paper, we study the behavior of Bayesian inference in the SBM in the large sample limit. Combining variational approximation and Laplace's method, a consistent criterion of the fully marginalized log-likelihood is established. Based on that, we derive a tractable algorithm that solves tasks (i) and (ii) concurrently, obviating the need for an outer loop to check all model candidates. Our empirical and theoretical results demonstrate that our method is scalable in computation, accurate in approximation, and concise in model selection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2015

Rebuilding Factorized Information Criterion: Asymptotically Accurate Marginal Likelihood

Factorized information criterion (FIC) is a recently developed approxima...
research
06/26/2015

Factorized Asymptotic Bayesian Inference for Factorial Hidden Markov Models

Factorial hidden Markov models (FHMMs) are powerful tools of modeling se...
research
07/15/2023

The Interpolating Information Criterion for Overparameterized Models

The problem of model selection is considered for the setting of interpol...
research
03/02/2017

The variational Laplace approach to approximate Bayesian inference

Variational approaches to approximate Bayesian inference provide very ef...
research
06/17/2022

Adapting the Linearised Laplace Model Evidence for Modern Deep Learning

The linearised Laplace method for estimating model uncertainty has recei...
research
01/23/2013

On Supervised Selection of Bayesian Networks

Given a set of possible models (e.g., Bayesian network structures) and a...
research
01/08/2021

A Bayesian Approach to Block-Term Tensor Decomposition Model Selection and Computation

The so-called block-term decomposition (BTD) tensor model, especially in...

Please sign up or login with your details

Forgot password? Click here to reset