D-MFVI: Distributed Mean Field Variational Inference using Bregman ADMM

Bayesian models provide a framework for probabilistic modelling of complex datasets. However, many of such models are computationally demanding especially in the presence of large datasets. On the other hand, in sensor network applications, statistical (Bayesian) parameter estimation usually needs distributed algorithms, in which both data and computation are distributed across the nodes of the network. In this paper we propose a general framework for distributed Bayesian learning using Bregman Alternating Direction Method of Multipliers (B-ADMM). We demonstrate the utility of our framework, with Mean Field Variational Bayes (MFVB) as the primitive for distributed Matrix Factorization (MF) and distributed affine structure from motion (SfM).

READ FULL TEXT
research
11/07/2014

Beta Process Non-negative Matrix Factorization with Stochastic Structured Mean-Field Variational Inference

Beta process is the standard nonparametric Bayesian prior for latent fac...
research
11/27/2020

Distributed Variational Bayesian Algorithms Over Sensor Networks

Distributed inference/estimation in Bayesian framework in the context of...
research
02/27/2018

ADMM-based Networked Stochastic Variational Inference

Owing to the recent advances in "Big Data" modeling and prediction tasks...
research
06/27/2012

Distributed Parameter Estimation via Pseudo-likelihood

Estimating statistical models within sensor networks requires distribute...
research
12/25/2017

On Statistical Optimality of Variational Bayes

The article addresses a long-standing open problem on the justification ...
research
07/24/2020

Fast and Accurate Estimation of Non-Nested Binomial Hierarchical Models Using Variational Inference

Estimating non-linear hierarchical models can be computationally burdens...
research
01/31/2023

Learning noisy-OR Bayesian Networks with Max-Product Belief Propagation

Noisy-OR Bayesian Networks (BNs) are a family of probabilistic graphical...

Please sign up or login with your details

Forgot password? Click here to reset