Transmission Neural Networks: From Virus Spread Models to Neural Networks

08/07/2022
by   Shuang Gao, et al.
0

This work connects models for virus spread on networks with their equivalent neural network representations. Based on this connection, we propose a new neural network architecture, called Transmission Neural Networks (TransNNs) where activation functions are primarily associated with links and are allowed to have different activation levels. Furthermore, this connection leads to the discovery and the derivation of three new activation functions with tunable or trainable parameters. Moreover, we prove that TransNNs with a single hidden layer and a fixed non-zero bias term are universal function approximators. Finally, we present new fundamental derivations of continuous time epidemic network models based on TransNNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2021

Neural networks with trainable matrix activation functions

The training process of neural networks usually optimize weights and bia...
research
05/02/2020

A survey on modern trainable activation functions

In the literature, there is a strong interest to identify and define act...
research
10/26/2021

Periodic Activation Functions Induce Stationarity

Neural network models are known to reinforce hidden data biases, making ...
research
06/20/2016

A New Training Method for Feedforward Neural Networks Based on Geometric Contraction Property of Activation Functions

We propose a new training method for a feedforward neural network having...
research
03/06/2015

Estimation of the parameters of an infectious disease model using neural networks

In this paper, we propose a realistic mathematical model taking into acc...
research
09/30/2018

Deep, Skinny Neural Networks are not Universal Approximators

In order to choose a neural network architecture that will be effective ...
research
12/02/2020

Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution

Binarization of neural network models is considered as one of the promis...

Please sign up or login with your details

Forgot password? Click here to reset