Inverse Ising problem in continuous time: A latent variable approach

09/04/2017
by   Christian Donner, et al.
0

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the likelihood into a form, which allows for simple iterative inference algorithms with analytical updates. The variables are: (1) Poisson variables to linearise an exponential term which is typical for point process likelihoods and (2) Pólya-Gamma variables, which make the likelihood quadratic in the coupling parameters. Using the augmented likelihood, we derive an expectation-maximization (EM) algorithm to obtain the maximum likelihood estimate of network parameters. Using a third set of latent variables we extend the EM algorithm to sparse couplings via L1 regularization. Finally, we develop an efficient approximate Bayesian inference algorithm using a variational approach. We demonstrate the performance of our algorithms on data simulated from an Ising model. For data which are simulated from a more biologically plausible network with spiking neurons, we show that the Ising model captures well the low order statistics of the data and how the Ising couplings are related to the underlying synaptic structure of the simulated network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/29/2019

Scalable Inference for Nonparametric Hawkes Process Using Pólya-Gamma Augmentation

In this paper, we consider the sigmoid Gaussian Hawkes process model: th...
research
06/23/2020

Efficient Inference of Nonparametric Interaction in Spiking-neuron Networks

Hawkes process provides an effective statistical framework for analyzing...
research
04/23/2022

Learning and Inference in Sparse Coding Models with Langevin Dynamics

We describe a stochastic, dynamical system capable of inference and lear...
research
01/22/2016

On the Latent Variable Interpretation in Sum-Product Networks

One of the central themes in Sum-Product networks (SPNs) is the interpre...
research
07/20/2022

Maximum Likelihood Imputation

Maximum likelihood (ML) estimation is widely used in statistics. The h-l...
research
01/14/2020

Analysis of Bayesian Inference Algorithms by the Dynamical Functional Approach

We analyze the dynamics of an algorithm for approximate inference with l...
research
06/20/2019

Multitaper Spectral Analysis of Neuronal Spiking Activity Driven by Latent Stationary Processes

Investigating the spectral properties of the neural covariates that unde...

Please sign up or login with your details

Forgot password? Click here to reset