Active Learning of Spin Network Models

03/25/2019
by   Jialong Jiang, et al.
0

Complex networks can be modeled as a probabilistic graphical model, where the interactions between binary variables, "spins", on nodes are described by a coupling matrix that is inferred from observations. The inverse statistical problem of finding direct interactions is difficult, especially for large systems, because of the exponential growth in the possible number of states and the possible number of networks. In the context of the experimental sciences, well-controlled perturbations can be applied to a system, shedding light on the internal structure of the network. Therefore, we propose a method to improve the accuracy and efficiency of inference by iteratively applying perturbations to a network that are advantageous under a Bayesian framework. The spectrum of the empirical Fisher information can be used as a measure for the difficulty of the inference during the training process. We significantly improve the accuracy and efficiency of inference in medium-sized networks based on this strategy with a reasonable number of experimental queries. Our method could be powerful in the analysis of complex networks as well as in the rational design of experiments.

READ FULL TEXT
research
11/11/2022

Understanding Approximation for Bayesian Inference in Neural Networks

Bayesian inference has theoretical attractions as a principled framework...
research
06/07/2020

BERT Loses Patience: Fast and Robust Inference with Early Exit

In this paper, we propose Patience-based Early Exit, a straightforward y...
research
08/04/2020

Controlling Information Capacity of Binary Neural Network

Despite the growing popularity of deep learning technologies, high memor...
research
10/05/2015

Learning in Unlabeled Networks - An Active Learning and Inference Approach

The task of determining labels of all network nodes based on the knowled...
research
05/11/2023

Sequential Experimental Design for Spectral Measurement: Active Learning Using a Parametric Model

In this study, we demonstrate a sequential experimental design for spect...
research
10/28/2019

Generative Well-intentioned Networks

We propose Generative Well-intentioned Networks (GWINs), a novel framewo...
research
10/17/2022

Statistics of High-Throughput Characterization of Microbial Interactions

An active area of research interest is the inference of ecological model...

Please sign up or login with your details

Forgot password? Click here to reset