Hybrid FEM-NN models: Combining artificial neural networks with the finite element method

01/04/2021
by   Sebastian K. Mitusch, et al.
17

We present a methodology combining neural networks with physical principle constraints in the form of partial differential equations (PDEs). The approach allows to train neural networks while respecting the PDEs as a strong constraint in the optimisation as apposed to making them part of the loss function. The resulting models are discretised in space by the finite element method (FEM). The methodology applies to both stationary and transient as well as linear/nonlinear PDEs. We describe how the methodology can be implemented as an extension of the existing FEM framework FEniCS and its algorithmic differentiation tool dolfin-adjoint. Through series of examples we demonstrate capabilities of the approach to recover coefficients and missing PDE operators from observations. Further, the proposed method is compared with alternative methodologies, namely, physics informed neural networks and standard PDE-constrained optimisation. Finally, we demonstrate the method on a complex cardiac cell model problem using deep neural networks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 12

page 13

page 14

page 22

page 24

03/04/2021

Physics-informed Neural Networks for Elliptic Partial Differential Equations on 3D Manifolds

Motivated by recent research on Physics-Informed Neural Networks (PINNs)...
12/18/2020

A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs

We introduce a hybrid "Modified Genetic Algorithm-Multilevel Stochastic ...
01/14/2022

Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's next

Physics-Informed Neural Networks (PINN) are neural networks (NNs) that e...
01/15/2020

Time evolution of the characteristic and probability density function of diffusion processes via neural networks

We investigate the use of physics-informed neural networks-based solutio...
02/24/2020

Physics Constrained Learning for Data-driven Inverse Modeling from Sparse Observations

Deep neural networks (DNN) have been used to model nonlinear relations b...
05/10/2019

Solving Irregular and Data-enriched Differential Equations using Deep Neural Networks

Recent work has introduced a simple numerical method for solving partial...
11/01/2021

Escaping the abstraction: a foreign function interface for the Unified Form Language [UFL]

High level domain specific languages for the finite element method under...

Code Repositories

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.