Physics-informed Neural Networks for Solving Inverse Problems of Nonlinear Biot's Equations: Batch Training

05/18/2020
by   Teeratorn Kadeethum, et al.
0

In biomedical engineering, earthquake prediction, and underground energy harvesting, it is crucial to indirectly estimate the physical properties of porous media since the direct measurement of those are usually impractical/prohibitive. Here we apply the physics-informed neural networks to solve the inverse problem with regard to the nonlinear Biot's equations. Specifically, we consider batch training and explore the effect of different batch sizes. The results show that training with small batch sizes, i.e., a few examples per batch, provides better approximations (lower percentage error) of the physical parameters than using large batches or the full batch. The increased accuracy of the physical parameters, comes at the cost of longer training time. Specifically, we find the size should not be too small since a very small batch size requires a very long training time without a corresponding improvement in estimation accuracy. We find that a batch size of 8 or 32 is a good compromise, which is also robust to additive noise in the data. The learning rate also plays an important role and should be used as a hyperparameter.

READ FULL TEXT

page 6

page 9

page 10

page 11

page 12

research
02/19/2020

Physics-informed Neural Networks for Solving Nonlinear Diffusivity and Biot's equations

This paper presents the potential of applying physics-informed neural ne...
research
12/20/2022

A Physics-Informed Neural Network to Model Port Channels

We describe a Physics-Informed Neural Network (PINN) that simulates the ...
research
06/24/2020

Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes

BERT has recently attracted a lot of attention in natural language under...
research
09/07/2022

Inverse modeling of nonisothermal multiphase poromechanics using physics-informed neural networks

We propose a solution strategy for parameter identification in multiphas...
research
07/13/2021

Automated Learning Rate Scheduler for Large-batch Training

Large-batch training has been essential in leveraging large-scale datase...
research
03/20/2022

Small Batch Sizes Improve Training of Low-Resource Neural MT

We study the role of an essential hyper-parameter that governs the train...
research
04/12/2023

Maximum-likelihood Estimators in Physics-Informed Neural Networks for High-dimensional Inverse Problems

Physics-informed neural networks (PINNs) have proven a suitable mathemat...

Please sign up or login with your details

Forgot password? Click here to reset