Power series expansion neural network

02/25/2021
by   Qipin Chen, et al.
0

In this paper, we develop a new neural network family based on power series expansion, which is proved to achieve a better approximation accuracy comparing to existing neural networks. This new set of neural networks can improve the expressive power while preserving comparable computational cost by increasing the degree of the network instead of increasing the depth or width. Numerical results have shown the advantage of this new neural network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2016

PolyNet: A Pursuit of Structural Diversity in Very Deep Networks

A number of studies have shown that increasing the depth or width of con...
research
05/19/2022

Neural Network Architecture Beyond Width and Depth

This paper proposes a new neural network architecture by introducing an ...
research
06/04/2020

A Polynomial Neural network with Controllable Precision and Human-Readable Topology II: Accelerated Approach Based on Expanded Layer

How about converting Taylor series to a network to solve the black-box n...
research
12/05/2016

Improving the Performance of Neural Networks in Regression Tasks Using Drawering

The method presented extends a given regression neural network to make i...
research
02/07/2023

On the relationship between multivariate splines and infinitely-wide neural networks

We consider multivariate splines and show that they have a random featur...
research
02/28/2021

A Proof of Concept Neural Network Watchdog using a Hybrid Generative Classifier For Optimized Outlier Detection

With the continuous development of tools such as TensorFlow and PyTorch,...
research
02/16/2015

Exploring Transfer Function Nonlinearity in Echo State Networks

Supralinear and sublinear pre-synaptic and dendritic integration is cons...

Please sign up or login with your details

Forgot password? Click here to reset