Constructing Multilayer Perceptrons as Piecewise Low-Order Polynomial Approximators: A Signal Processing Approach

10/15/2020
by   Ruiyuan Lin, et al.
0

The construction of a multilayer perceptron (MLP) as a piecewise low-order polynomial approximator using a signal processing approach is presented in this work. The constructed MLP contains one input, one intermediate and one output layers. Its construction includes the specification of neuron numbers and all filter weights. Through the construction, a one-to-one correspondence between the approximation of an MLP and that of a piecewise low-order polynomial is established. Comparison between piecewise polynomial and MLP approximations is made. Since the approximation capability of piecewise low-order polynomials is well understood, our findings shed light on the universal approximation capability of an MLP.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/22/2013

Piecewise Linear Multilayer Perceptrons and Dropout

We propose a new type of hidden layer for a multilayer perceptron, and d...
research
05/19/2022

Automatic Generation of Complete Polynomial Interpolation Hardware Design Space

Hardware implementations of complex functions regularly deploy piecewise...
research
08/22/2018

An Explicit Neural Network Construction for Piecewise Constant Function Approximation

We present an explicit construction for feedforward neural network (FNN)...
research
02/22/2020

SURF: A Simple, Universal, Robust, Fast Distribution Learning Algorithm

Sample- and computationally-efficient distribution estimation is a funda...
research
11/20/2021

Study of Polar Codes Based on Piecewise Gaussian Approximation

In this paper, we investigate the construction of polar codes by Gaussia...
research
05/15/2015

Discontinuous Piecewise Polynomial Neural Networks

An artificial neural network is presented based on the idea of connectio...
research
04/25/2023

Stable Lifting of Polynomial Traces on Triangles

We construct a right inverse of the trace operator u ↦ (u|_∂ T, ∂_n u|_∂...

Please sign up or login with your details

Forgot password? Click here to reset