Spectral Neural Operators

05/21/2022
by   V. Fanaskov, et al.
0

A plentitude of applications in scientific computing requires the approximation of mappings between Banach spaces. Recently introduced Fourier Neural Operator (FNO) and Deep Operator Network (DeepONet) can provide this functionality. For both of these neural operators, the input function is sampled on a given grid (uniform for FNO), and the output function is parametrized by a neural network. We argue that this parametrization leads to 1) opaque output that is hard to analyze and 2) systematic bias caused by aliasing errors in the case of FNO. The alternative, advocated in this article, is to use Chebyshev and Fourier series for both domain and codomain. The resulting Spectral Neural Operator (SNO) has transparent output, never suffers from aliasing, and may include many exact (lossless) operations on functions. The functionality is based on well-developed fast, and stable algorithms from spectral methods. The implementation requires only standard numerical linear algebra. Our benchmarks show that for many operators, SNO is superior to FNO and DeepONet.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2022

MIONet: Learning multiple-input operators via tensor product

As an emerging paradigm in scientific machine learning, neural operators...
research
04/26/2023

The Nonlocal Neural Operator: Universal Approximation

Neural operator architectures approximate operators between infinite-dim...
research
11/09/2021

A research framework for writing differentiable PDE discretizations in JAX

Differentiable simulators are an emerging concept with applications in s...
research
02/16/2023

Laplace neural operator for complex geometries

Neural operators have emerged as a new area of machine learning for lear...
research
05/08/2019

Spectral Coarsening of Geometric Operators

We introduce a novel approach to measure the behavior of a geometric ope...
research
04/30/2023

Domain Agnostic Fourier Neural Operators

Fourier neural operators (FNOs) can learn highly nonlinear mappings betw...
research
03/09/2022

On the influence of over-parameterization in manifold based surrogates and deep neural operators

Constructing accurate and generalizable approximators for complex physic...

Please sign up or login with your details

Forgot password? Click here to reset