Unsupervised Learning of Solutions to Differential Equations with Generative Adversarial Networks

07/21/2020
by   Dylan Randle, et al.
16

Solutions to differential equations are of significant scientific and engineering relevance. Recently, there has been a growing interest in solving differential equations with neural networks. This work develops a novel method for solving differential equations with unsupervised neural networks that applies Generative Adversarial Networks (GANs) to learn the loss function for optimizing the neural network. We present empirical results showing that our method, which we call Differential Equation GAN (DEQGAN), can obtain multiple orders of magnitude lower mean squared errors than an alternative unsupervised neural network method based on (squared) L_2, L_1, and Huber loss functions. Moreover, we show that DEQGAN achieves solution accuracy that is competitive with traditional numerical methods. Finally, we analyze the stability of our approach and find it to be sensitive to the selection of hyperparameters, which we provide in the appendix. Code available at https://github.com/dylanrandle/denn. Please address any electronic correspondence to dylanrandle@alumni.harvard.edu.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2022

DEQGAN: Learning the Loss Function for PINNs with Generative Adversarial Networks

Solutions to differential equations are of significant scientific and en...
research
10/23/2022

Less Emphasis on Difficult Layer Regions: Curriculum Learning for Singularly Perturbed Convection-Diffusion-Reaction Problems

Although Physics-Informed Neural Networks (PINNs) have been successfully...
research
02/05/2022

LyaNet: A Lyapunov Framework for Training Neural ODEs

We propose a method for training ordinary differential equations by usin...
research
11/20/2021

Adversarial Sampling for Solving Differential Equations with Neural Networks

Neural network-based methods for solving differential equations have bee...
research
03/04/2021

SVMax: A Feature Embedding Regularizer

A neural network regularizer (e.g., weight decay) boosts performance by ...
research
12/13/2018

Theory of Connections Applied to Support Vector Machines to Solve Differential Equations

Differential equations are used as numerical models to describe physical...
research
02/09/2020

On the distance between two neural networks and the stability of learning

How far apart are two neural networks? This is a foundational question i...

Please sign up or login with your details

Forgot password? Click here to reset