Path sampling of recurrent neural networks by incorporating known physics

03/01/2022
by   Sun-Ting Tsai, et al.
0

Recurrent neural networks have seen widespread use in modeling dynamical systems in varied domains such as weather prediction, text prediction and several others. Often one wishes to supplement the experimentally observed dynamics with prior knowledge or intuition about the system. While the recurrent nature of these networks allows them to model arbitrarily long memories in the time series used in training, it makes it harder to impose prior knowledge or intuition through generic constraints. In this work, we present a path sampling approach based on principle of Maximum Caliber that allows us to include generic thermodynamic or kinetic constraints into recurrent neural networks. We show the method here for a widely used type of recurrent neural network known as long short-term memory network in the context of supplementing time series collecting from all-atom molecular dynamics. We demonstrate the power of the formalism for different applications. Our method can be easily generalized to other generative artificial intelligence models and to generic time series in different areas of physical and social sciences, where one wishes to supplement limited data with intuition or theory based corrections.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/27/2021

Recurrent-type Neural Networks for Real-time Short-term Prediction of Ship Motions in High Sea State

The prediction capability of recurrent-type neural networks is investiga...
research
04/04/2019

Inferring the dynamics of oscillatory systems using recurrent neural networks

We investigate the predictive power of recurrent neural networks for osc...
research
03/01/2022

Molecular Dynamics of Polymer-lipids in Solution from Supervised Machine Learning

Machine learning techniques including neural networks are popular tools ...
research
03/04/2020

Forecasting Sequential Data using Consistent Koopman Autoencoders

Recurrent neural networks are widely used on time series data, yet such ...
research
07/22/2014

Deep Recurrent Neural Networks for Time Series Prediction

Ability of deep networks to extract high level features and of recurrent...
research
08/25/2020

Prediction of Hilbertian autoregressive processes : a Recurrent Neural Network approach

The autoregressive Hilbertian model (ARH) was introduced in the early 90...
research
06/29/2011

Implementing Human-like Intuition Mechanism in Artificial Intelligence

Human intuition has been simulated by several research projects using ar...

Please sign up or login with your details

Forgot password? Click here to reset