Multilayer Perceptron-based Surrogate Models for Finite Element Analysis

11/17/2022

∙

Many Partial Differential Equations (PDEs) do not have analytical solution, and can only be solved by numerical methods. In this context, Physics-Informed Neural Networks (PINN) have become important in the last decades, since it uses a neural network and physical conditions to approximate any functions. This paper focuses on hypertuning of a PINN, used to solve a PDE. The behavior of the approximated solution when we change the learning rate or the activation function (sigmoid, hyperbolic tangent, GELU, ReLU and ELU) is here analyzed. A comparative study is done to determine the best characteristics in the problem, as well as to find a learning rate that allows fast and satisfactory learning. GELU and hyperbolic tangent activation functions exhibit better performance than other activation functions. A suitable choice of the learning rate results in higher accuracy and faster convergence.

READ FULL TEXT

Multilayer Perceptron-based Surrogate Models for Finite Element Analysis

Physics-Informed Kernel Function Neural Networks for Solving Partial Differential Equations

On the Compatibility between a Neural Network and a Partial Differential Equation for Physics-informed Learning

Fast generalization error bound of deep learning without scale invariance of activation functions

On the Identification and Optimization of Nonsmooth Superposition Operators in Semilinear Elliptic PDEs

Non-constant bounded holomorphic functions of hyperbolic numbers - Candidates for hyperbolic activation functions

Data-driven discovery of Green's functions

Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)

Multilayer Perceptron-based Surrogate Models for Finite Element Analysis

Related Research

Physics-Informed Kernel Function Neural Networks for Solving Partial Differential Equations

On the Compatibility between a Neural Network and a Partial Differential Equation for Physics-informed Learning

Fast generalization error bound of deep learning without scale invariance of activation functions

On the Identification and Optimization of Nonsmooth Superposition Operators in Semilinear Elliptic PDEs

Non-constant bounded holomorphic functions of hyperbolic numbers - Candidates for hyperbolic activation functions

Data-driven discovery of Green's functions

Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)