Variational perturbation and extended Plefka approaches to dynamics on random networks: the case of the kinetic Ising model

We describe and analyze some novel approaches for studying the dynamics of Ising spin glass models. We first briefly consider the variational approach based on minimizing the Kullback-Leibler divergence between independent trajectories and the real ones and note that this approach only coincides with the mean field equations from the saddle point approximation to the generating functional when the dynamics is defined through a logistic link function, which is the case for the kinetic Ising model with parallel update. We then spend the rest of the paper developing two ways of going beyond the saddle point approximation to the generating functional. In the first one, we develop a variational perturbative approximation to the generating functional by expanding the action around a quadratic function of the local fields and conjugate local fields whose parameters are optimized. We derive analytical expressions for the optimal parameters and show that when the optimization is suitably restricted, we recover the mean field equations that are exact for the fully asymmetric random couplings (Mézard and Sakellariou, 2011). However, without this restriction the results are different. We also describe an extended Plefka expansion in which in addition to the magnetization, we also fix the correlation and response functions. Finally, we numerically study the performance of these approximations for Sherrington-Kirkpatrick type couplings for various coupling strengths, degrees of coupling symmetry and external fields. We show that the dynamical equations derived from the extended Plefka expansion outperform the others in all regimes, although it is computationally more demanding. The unconstrained variational approach does not perform well in the small coupling regime, while it approaches dynamical TAP equations of (Roudi and Hertz, 2011) for strong couplings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2013

Variational Approximations between Mean Field Theory and the Junction Tree Algorithm

Recently, variational approximations such as the mean field approximatio...
research
01/07/2022

Projective Embedding of Dynamical Systems: uniform mean field equations

We study embeddings of continuous dynamical systems in larger dimensions...
research
01/14/2020

Numerical methods for mean-field stochastic differential equations with jumps

In this paper, we are devoted to the numerical methods for mean-field st...
research
02/05/2021

The Critical Mean-field Chayes-Machta Dynamics

The random-cluster model is a unifying framework for studying random gra...
research
01/11/2023

On the functional form of the radial acceleration relation

We apply a new method for learning equations from data – Exhaustive Symb...
research
08/25/2020

Rate Equations for Graphs

In this paper, we combine ideas from two different scientific traditions...
research
03/24/2022

Extended critical regimes of deep neural networks

Deep neural networks (DNNs) have been successfully applied to many real-...

Please sign up or login with your details

Forgot password? Click here to reset