ConCerNet: A Contrastive Learning Based Framework for Automated Conservation Law Discovery and Trustworthy Dynamical System Prediction

02/11/2023
by   Wang Zhang, et al.
0

Deep neural networks (DNN) have shown great capacity of modeling a dynamical system; nevertheless, they usually do not obey physics constraints such as conservation laws. This paper proposes a new learning framework named ConCerNet to improve the trustworthiness of the DNN based dynamics modeling to endow the invariant properties. ConCerNet consists of two steps: (i) a contrastive learning method to automatically capture the system invariants (i.e. conservation properties) along the trajectory observations; (ii) a neural projection layer to guarantee that the learned dynamics models preserve the learned invariants. We theoretically prove the functional relationship between the learned latent representation and the unknown system invariant function. Experiments show that our method consistently outperforms the baseline neural networks in both coordinate error and conservation metrics by a large margin. With neural network based parameterization and no dependence on prior knowledge, our method can be extended to complex and large-scale dynamics by leveraging an autoencoder.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2021

Functional equivariance and conservation laws in numerical integration

Preservation of linear and quadratic invariants by numerical integrators...
research
12/31/2019

Interpretable Conservation Law Estimation by Deriving the Symmetries of Dynamics from Trained Deep Neural Networks

As deep neural networks (DNN) have the ability to model the distribution...
research
02/08/2021

Discovering conservation laws from trajectories via machine learning

Invariants and conservation laws convey critical information about the u...
research
11/25/2022

Designing Neural Networks for Hyperbolic Conservation Laws

We propose a new data-driven method to learn the dynamics of an unknown ...
research
10/01/2022

FINDE: Neural Differential Equations for Finding and Preserving Invariant Quantities

Many real-world dynamical systems are associated with first integrals (a...
research
06/01/2023

Training neural operators to preserve invariant measures of chaotic attractors

Chaotic systems make long-horizon forecasts difficult because small pert...
research
10/04/2022

Neural Conservation Laws: A Divergence-Free Perspective

We investigate the parameterization of deep neural networks that by desi...

Please sign up or login with your details

Forgot password? Click here to reset