Competitive Physics Informed Networks

04/23/2022
by   Qi Zeng, et al.
0

Physics Informed Neural Networks (PINNs) solve partial differential equations (PDEs) by representing them as neural networks. The original PINN implementation does not provide high accuracy, typically attaining about 0.1% relative error. We formulate and test an adversarial approach called competitive PINNs (CPINNs) to overcome this limitation. CPINNs train a discriminator that is rewarded for predicting PINN mistakes. The discriminator and PINN participate in a zero-sum game with the exact PDE solution as an optimal strategy. This approach avoids the issue of squaring the large condition numbers of PDE discretizations. Numerical experiments show that a CPINN trained with competitive gradient descent can achieve errors two orders of magnitude smaller than that of a PINN trained with Adam or stochastic gradient descent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/28/2020

Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory

Deep learning has significantly revolutionized the design of numerical a...
research
12/15/2022

Neuroevolution Surpasses Stochastic Gradient Descent for Physics-Informed Neural Networks

The potential of learned models for fundamental scientific research and ...
research
02/04/2022

PSO-PINN: Physics-Informed Neural Networks Trained with Particle Swarm Optimization

Physics-informed neural networks (PINNs) have recently emerged as a prom...
research
06/10/2020

Stochastic Gradient Descent for Semilinear Elliptic Equations with Uncertainties

Randomness is ubiquitous in modern engineering. The uncertainty is often...
research
06/05/2023

MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networks

Physics-informed Neural Networks (PINNs) have recently achieved remarkab...
research
05/26/2021

Optimal Transport Based Refinement of Physics-Informed Neural Networks

In this paper, we propose a refinement strategy to the well-known Physic...
research
10/26/2021

Stable Anderson Acceleration for Deep Learning

Anderson acceleration (AA) is an extrapolation technique designed to spe...

Please sign up or login with your details

Forgot password? Click here to reset