Analytic relations between networks: encoding, decoding, and causality

07/14/2022
by   Yang Tian, et al.
0

Networks are common in physics, biology, computer science, and social science. Quantifying the relations (e.g., similarity) between networks paves the way for understanding the latent information shared across networks. However, fundamental metrics of relations, such as information divergence, mutual information, Fisher information, and causality, are not well-defined between networks. As a compromise, commonly used strategies (e.g., network embedding, matching, and kernel approaches) measure network relations in data-driven ways. These approaches are computation-oriented and inapplicable to analytic derivations in mathematics and physics. To resolve these issues, we present a theory to derive an optimal characterization of network topological properties. Our theory shows that a network can be fully represented by a Gaussian variable defined by the discrete Schrödinger operator, which simultaneously satisfies network-topology-dependent smoothness and maximum entropy properties. Based on this characterization, we can analytically measure diverse relations between networks in terms of topology properties. As illustrations, we primarily show how to define encoding (e.g., information divergence and mutual information), decoding (e.g., Fisher information), and causality (e.g., transfer entropy and Granger causality) between networks. We validate our framework on representative networks (e.g., evolutionary random network models, protein-protein interaction network, and chemical compound networks), and demonstrate that a series of science and engineering challenges (e.g., network evolution, clustering, and classification) can be tackled from a new perspective. A computationally efficient implementation of our theory is released as an open-source toolbox.

READ FULL TEXT

page 4

page 7

page 9

page 11

page 13

research
05/02/2020

Conditional Rényi entropy and the relationships between Rényi capacities

The analogues of Arimoto's definition of conditional Rényi entropy and R...
research
10/10/2019

Estimating Transfer Entropy via Copula Entropy

Causal inference is a fundemental problem in statistics and has wide app...
research
10/22/2022

Quantifying Complexity: An Object-Relations Approach to Complex Systems

The best way to model, understand, and quantify the information containe...
research
01/04/2021

The Atlas for the Aspiring Network Scientist

Network science is the field dedicated to the investigation and analysis...
research
04/10/2018

An information-theoretic, all-scales approach to comparing networks

As network research becomes more sophisticated, it is more common than e...
research
04/27/2015

Simple Derivation of the Lifetime and the Distribution of Faces for a Binary Subdivision Model

The iterative random subdivision of rectangles is used as a generation m...
research
08/31/2019

Small worlds and clustering in spatial networks

Networks with underlying metric spaces attract increasing research atten...

Please sign up or login with your details

Forgot password? Click here to reset