Training Algorithm Matters for the Performance of Neural Network Potential

09/08/2021
by   Yunqi Shao, et al.
0

One hidden yet important issue for developing neural network potentials (NNPs) is the choice of training algorithm. Here we compare the performance of two popular training algorithms, the adaptive moment estimation algorithm (Adam) and the extended Kalman filter algorithm (EKF), using the Behler-Parrinello neural network (BPNN) and two publicly accessible datasets of liquid water. It is found that NNPs trained with EKF are more transferable and less sensitive to the value of the learning rate, as compared to Adam. In both cases, error metrics of the test set do not always serve as a good indicator for the actual performance of NNPs. Instead, we show that their performance correlates well with a Fisher information based similarity measure.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2020

AutoLR: An Evolutionary Approach to Learning Rate Policies

The choice of a proper learning rate is paramount for good Artificial Ne...
research
04/01/2023

Sequential Learning from Noisy Data: Data-Assimilation Meets Echo-State Network

This paper explores the problem of training a recurrent neural network f...
research
11/25/2019

Stability of the Decoupled Extended Kalman Filter Learning Algorithm in LSTM-Based Online Learning

We investigate the convergence and stability properties of the decoupled...
research
12/09/2021

Online Adaptation of Neural Network Models by Modified Extended Kalman Filter for Customizable and Transferable Driving Behavior Prediction

High fidelity behavior prediction of human drivers is crucial for effici...
research
08/22/2014

Recurrent Neural Network Based Hybrid Model of Gene Regulatory Network

Systems biology is an emerging interdisciplinary area of research that f...
research
12/17/2022

Improving Levenberg-Marquardt Algorithm for Neural Networks

We explore the usage of the Levenberg-Marquardt (LM) algorithm for regre...
research
04/23/2020

Deep Learning of Chaos Classification

We train an artificial neural network which distinguishes chaotic and re...

Please sign up or login with your details

Forgot password? Click here to reset