Neural Dynamics on Complex Networks

08/18/2019
by   Chengxi Zang, et al.
0

We introduce a deep learning model to learn continuous-time dynamics on complex networks and infer the semantic labels of nodes in the network at terminal time. We formulate the problem as an optimal control problem by minimizing a loss function consisting of a running loss of network dynamics, a terminal loss of nodes' labels, and a neural-differential-equation-system constraint. We solve the problem by a differential deep learning framework: as for the forward process of the system, rather than forwarding through a discrete number of hidden layers, we integrate the ordinary differential equation systems on graphs over continuous time; as for the backward learning process, we learn the optimal control parameters by back-propagation during solving initial value problem. We validate our model by learning complex dynamics on various real-world complex networks, and then apply our model to graph semi-supervised classification tasks. The promising experimental results demonstrate our model's capability of jointly capturing the structure, dynamics and semantics of complex systems.

READ FULL TEXT

page 20

page 21

page 22

page 23

research
04/11/2019

Deep learning as optimal control problems: models and numerical methods

We consider recent work of Haber and Ruthotto 2017 and Chang et al. 2018...
research
07/22/2020

Time-Reversal Symmetric ODE Network

Time-reversal symmetry, which requires that the dynamics of a system sho...
research
10/16/2020

Neural Ordinary Differential Equations for Intervention Modeling

By interpreting the forward dynamics of the latent representation of neu...
research
02/26/2021

Sparse approximation in learning via neural ODEs

We consider the continuous-time, neural ordinary differential equation (...
research
05/23/2019

Neural ODEs with stochastic vector field mixtures

It was recently shown that neural ordinary differential equation models ...
research
07/05/2020

Depth-Adaptive Neural Networks from the Optimal Control viewpoint

In recent years, deep learning has been connected with optimal control a...
research
06/18/2020

A Shooting Formulation of Deep Learning

Continuous-depth neural networks can be viewed as deep limits of discret...

Please sign up or login with your details

Forgot password? Click here to reset