Message Passing Neural PDE Solvers

02/07/2022
by   Johannes Brandstetter, et al.
26

The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural–numerical hybrid solvers, which piggy-backs the modern trend towards fully end-to-end learned systems. Most works so far can only generalize over a subset of properties to which a generic solver would be faced, including: resolution, topology, geometry, boundary conditions, domain discretization regularity, dimensionality, etc. In this work, we build a solver, satisfying these properties, where all the components are based on neural message passing, replacing all heuristically designed components in the computation graph with backprop-optimized neural function approximators. We show that neural message passing solvers representationally contain some classical methods, such as finite differences, finite volumes, and WENO schemes. In order to encourage stability in training autoregressive models, we put forward a method that is based on the principle of zero-stability, posing stability as a domain adaptation problem. We validate our method on various fluid-like flow problems, demonstrating fast, stable, and accurate performance across different domain topologies, discretization, etc. in 1D and 2D. Our model outperforms state-of-the-art numerical solvers in the low resolution regime in terms of speed and accuracy.

READ FULL TEXT

page 7

page 18

page 19

page 25

research
04/15/2022

Learning time-dependent PDE solver using Message Passing Graph Neural Networks

One of the main challenges in solving time-dependent partial differentia...
research
10/25/2022

JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuities

We present a scalable strategy for development of mesh-free hybrid neuro...
research
02/12/2012

Message passing for quantified Boolean formulas

We introduce two types of message passing algorithms for quantified Bool...
research
03/07/2020

Neural Operator: Graph Kernel Network for Partial Differential Equations

The classical development of neural networks has been primarily for mapp...
research
12/31/2021

Improved Algorithm for the Network Alignment Problem with Application to Binary Diffing

In this paper, we present a novel algorithm to address the Network Align...
research
09/04/2023

Turbulent Flow Simulation using Autoregressive Conditional Diffusion Models

Simulating turbulent flows is crucial for a wide range of applications, ...
research
02/14/2022

Learned Turbulence Modelling with Differentiable Fluid Solvers

In this paper, we train turbulence models based on convolutional neural ...

Please sign up or login with your details

Forgot password? Click here to reset