Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equations

12/09/2022
by   Wuzhe Xu, et al.
0

Deep operator network (DeepONet) has demonstrated great success in various learning tasks, including learning solution operators of partial differential equations. In particular, it provides an efficient approach to predict the evolution equations in a finite time horizon. Nevertheless, the vanilla DeepONet suffers from the issue of stability degradation in the long-time prediction. This paper proposes a transfer-learning aided DeepONet to enhance the stability. Our idea is to use transfer learning to sequentially update the DeepONets as the surrogates for propagators learned in different time frames. The evolving DeepONets can better track the varying complexities of the evolution equations, while only need to be updated by efficient training of a tiny fraction of the operator networks. Through systematic experiments, we show that the proposed method not only improves the long-time accuracy of DeepONet while maintaining similar computational cost but also substantially reduces the sample size of the training set.

READ FULL TEXT

page 7

page 13

page 14

page 15

page 16

research
02/19/2022

Function-valued RKHS-based Operator Learning for Differential Equations

Recently, a steam of works seek for solving a family of partial differen...
research
01/21/2020

Transfer Learning using Neural Ordinary Differential Equations

A concept of using Neural Ordinary Differential Equations(NODE) for Tran...
research
04/09/2023

Variational operator learning: A unified paradigm for training neural operators and solving partial differential equations

Based on the variational method, we propose a novel paradigm that provid...
research
11/01/2022

Transfer Learning with Physics-Informed Neural Networks for Efficient Simulation of Branched Flows

Physics-Informed Neural Networks (PINNs) offer a promising approach to s...
research
07/28/2022

Semi-supervised Learning of Partial Differential Operators and Dynamical Flows

The evolution of dynamical systems is generically governed by nonlinear ...
research
01/19/2023

Discover governing differential equations from evolving systems

Discovering the governing equations of evolving systems from available o...
research
05/19/2023

Tune-Mode ConvBN Blocks For Efficient Transfer Learning

Convolution-BatchNorm (ConvBN) blocks are integral components in various...

Please sign up or login with your details

Forgot password? Click here to reset