Variational operator learning: A unified paradigm for training neural operators and solving partial differential equations

04/09/2023
by   Tengfei Xu, et al.
0

Based on the variational method, we propose a novel paradigm that provides a unified framework of training neural operators and solving partial differential equations (PDEs) with the variational form, which we refer to as the variational operator learning (VOL). We first derive the functional approximation of the system from the node solution prediction given by neural operators, and then conduct the variational operation by automatic differentiation, constructing a forward-backward propagation loop to derive the residual of the linear system. One or several update steps of the steepest decent method (SD) and the conjugate gradient method (CG) are provided in every iteration as a cheap yet effective update for training the neural operators. Experimental results show the proposed VOL can learn a variety of solution operators in PDEs of the steady heat transfer and the variable stiffness elasticity with satisfactory results and small error. The proposed VOL achieves nearly label-free training. Only five to ten labels are used for the output distribution-shift session in all experiments. Generalization benefits of the VOL are investigated and discussed.

READ FULL TEXT

page 5

page 14

page 23

page 24

page 27

page 28

page 29

page 30

research
06/28/2023

HNO: Hyena Neural Operator for solving PDEs

Numerically solving partial differential equations (PDEs) typically requ...
research
01/28/2022

Pseudo-Differential Integral Operator for Learning Solution Operators of Partial Differential Equations

Learning mapping between two function spaces has attracted considerable ...
research
12/28/2021

Frame invariance and scalability of neural operators for partial differential equations

Partial differential equations (PDEs) play a dominant role in the mathem...
research
12/09/2022

Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equations

Deep operator network (DeepONet) has demonstrated great success in vario...
research
06/07/2023

A novel deeponet model for learning moving-solution operators with applications to earthquake hypocenter localization

Seismicity induced by human activities poses a significant threat to pub...
research
10/03/2022

Random Weight Factorization Improves the Training of Continuous Neural Representations

Continuous neural representations have recently emerged as a powerful an...
research
01/29/2019

Variational Characterizations of Local Entropy and Heat Regularization in Deep Learning

The aim of this paper is to provide new theoretical and computational un...

Please sign up or login with your details

Forgot password? Click here to reset