Statistical mechanics of the inverse Ising problem and the optimal objective function

11/14/2016
by   Johannes Berg, et al.
0

The inverse Ising problem seeks to reconstruct the parameters of an Ising Hamiltonian on the basis of spin configurations sampled from the Boltzmann measure. Over the last decade, many applications of the inverse Ising problem have arisen, driven by the advent of large-scale data across different scientific disciplines. Recently, strategies to solve the inverse Ising problem based on convex optimisation have proven to be very successful. These approaches maximise particular objective functions with respect to the model parameters. Examples are the pseudolikelihood method and interaction screening. In this paper, we establish a link between approaches to the inverse Ising problem based on convex optimisation and the statistical physics of disordered systems. We characterise the performance of an arbitrary objective function and calculate the objective function which optimally reconstructs the model parameters. We evaluate the optimal objective function within a replica-symmetric ansatz and compare the results of the optimal objective function with other reconstruction methods. Apart from giving a theoretical underpinning to solving the inverse Ising problem by convex optimisation, the optimal objective function outperforms state-of-the-art methods, albeit by a small margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/10/2022

Batch Bayesian Optimization via Particle Gradient Flows

Bayesian Optimisation (BO) methods seek to find global optima of objecti...
research
04/23/2012

Objective Function Designing Led by User Preferences Acquisition

Many real world problems can be defined as optimisation problems in whic...
research
03/08/2022

A Jacobian Free Deterministic Method for Solving Inverse Problems

An effective numerical method is presented for optimizing model paramete...
research
06/25/2018

Predicting Effective Control Parameters for Differential Evolution using Cluster Analysis of Objective Function Features

A methodology is introduced which uses three simple objective function f...
research
11/21/2014

On the Impossibility of Convex Inference in Human Computation

Human computation or crowdsourcing involves joint inference of the groun...
research
06/20/2017

Statistical Mechanics of Node-perturbation Learning with Noisy Baseline

Node-perturbation learning is a type of statistical gradient descent alg...
research
05/20/2022

Machine Learning for Combinatorial Optimisation of Partially-Specified Problems: Regret Minimisation as a Unifying Lens

It is increasingly common to solve combinatorial optimisation problems t...

Please sign up or login with your details

Forgot password? Click here to reset