Effects of boundary conditions in fully convolutional networks for learning spatio-temporal dynamics

Accurate modeling of boundary conditions is crucial in computational physics. The ever increasing use of neural networks as surrogates for physics-related problems calls for an improved understanding of boundary condition treatment, and its influence on the network accuracy. In this paper, several strategies to impose boundary conditions (namely padding, improved spatial context, and explicit encoding of physical boundaries) are investigated in the context of fully convolutional networks applied to recurrent tasks. These strategies are evaluated on two spatio-temporal evolving problems modeled by partial differential equations: the 2D propagation of acoustic waves (hyperbolic PDE) and the heat equation (parabolic PDE). Results reveal a high sensitivity of both accuracy and stability on the boundary implementation in such recurrent tasks. It is then demonstrated that the choice of the optimal padding strategy is directly linked to the data semantics. Furthermore, the inclusion of additional input spatial context or explicit physics-based rules allows a better handling of boundaries in particular for large number of recurrences, resulting in more robust and stable neural networks, while facilitating the design and versatility of such networks.

READ FULL TEXT
research
11/30/2020

A New Treatment of Boundary Conditions in PDE Solutions with Galerkin Methods via Partial Integral Equation Framework

We present a new framework for solution of Partial Differential Equation...
research
05/24/2022

Physics-Embedded Neural Networks: E(n)-Equivariant Graph Neural PDE Solvers

Graph neural network (GNN) is a promising approach to learning and predi...
research
05/12/2021

On the reproducibility of fully convolutional neural networks for modeling time-space evolving physical systems

Reproducibility of a deep-learning fully convolutional neural network is...
research
02/16/2023

Learning-based solutions to nonlinear hyperbolic PDEs: Empirical insights on generalization errors

We study learning weak solutions to nonlinear hyperbolic partial differe...
research
06/27/2023

Implicit Boundary Conditions in Partial Differential Equations Discretizations: Identifying Spurious Modes and Model Reduction

We revisit the problem of spurious modes that are sometimes encountered ...
research
08/28/2018

Quantifying spatio-temporal boundary condition uncertainty for the North American deglaciation

Ice sheet models are used to study the deglaciation of North America at ...

Please sign up or login with your details

Forgot password? Click here to reset