Computational characteristics of feedforward neural networks for solving a stiff differential equation

by   Toni Schneidereit, et al.

Feedforward neural networks offer a promising approach for solving differential equations. However, the reliability and accuracy of the approximation still represent delicate issues that are not fully resolved in the current literature. Computational approaches are in general highly dependent on a variety of computational parameters as well as on the choice of optimisation methods, a point that has to be seen together with the structure of the cost function. The intention of this paper is to make a step towards resolving these open issues. To this end we study here the solution of a simple but fundamental stiff ordinary differential equation modelling a damped system. We consider two computational approaches for solving differential equations by neural forms. These are the classic but still actual method of trial solutions defining the cost function, and a recent direct construction of the cost function related to the trial solution method. Let us note that the settings we study can easily be applied more generally, including solution of partial differential equations. By a very detailed computational study we show that it is possible to identify preferable choices to be made for parameters and methods. We also illuminate some interesting effects that are observable in the neural network simulations. Overall we extend the current literature in the field by showing what can be done in order to obtain reliable and accurate results by the neural network approach. By doing this we illustrate the importance of a careful choice of the computational setup.



There are no comments yet.


page 1

page 2

page 3

page 4


Collocation Polynomial Neural Forms and Domain Fragmentation for Initial Value Problems

Several neural network approaches for solving differential equations emp...

Adaptive Neural Domain Refinement for Solving Time-Dependent Differential Equations

A classic approach for solving differential equations with neural networ...

A unified deep artificial neural network approach to partial differential equations in complex geometries

We use deep feedforward artificial neural networks to approximate soluti...

ODEN: A Framework to Solve Ordinary Differential Equations using Artificial Neural Networks

We explore in detail a method to solve ordinary differential equations u...

Deep Neural Network Based Differential Equation Solver for HIV Enzyme Kinetics

Purpose: We seek to use neural networks (NNs) to solve a well-known syst...

Adversarial Sampling for Solving Differential Equations with Neural Networks

Neural network-based methods for solving differential equations have bee...

Neural Networks to solve Partial Differential Equations: a Comparison with Finite Elements

We compare the Finite Element Method (FEM) simulation of a standard Part...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.