Transfer learning for chemically accurate interatomic neural network potentials

12/07/2022
by   Viktor Zaverkin, et al.
0

Developing machine learning-based interatomic potentials from ab-initio electronic structure methods remains a challenging task for computational chemistry and materials science. This work studies the capability of transfer learning for efficiently generating chemically accurate interatomic neural network potentials on organic molecules from the MD17 and ANI data sets. We show that pre-training the network parameters on data obtained from density functional calculations considerably improves the sample efficiency of models trained on more accurate ab-initio data. Additionally, we show that fine-tuning with energy labels alone suffices to obtain accurate atomic forces and run large-scale atomistic simulations. We also investigate possible limitations of transfer learning, especially regarding the design and size of the pre-training and fine-tuning data sets. Finally, we provide GM-NN potentials pre-trained and fine-tuned on the ANI-1x and ANI-1ccx data sets, which can easily be fine-tuned on and applied to organic molecules.

READ FULL TEXT

page 9

page 12

research
07/19/2022

Similarity of Pre-trained and Fine-tuned Representations

In transfer learning, only the last part of the networks - the so-called...
research
03/03/2023

Denoise Pre-training on Non-equilibrium Molecules for Accurate and Transferable Neural Potentials

Machine learning methods, particularly recent advances in equivariant gr...
research
05/02/2022

FINETUNA: Fine-tuning Accelerated Molecular Simulations

Machine learning approaches have the potential to approximate Density Fu...
research
09/20/2021

Fast and Sample-Efficient Interatomic Neural Network Potentials for Molecules and Materials Based on Gaussian Moments

Artificial neural networks (NNs) are one of the most frequently used mac...
research
10/14/2022

Injecting Domain Knowledge from Empirical Interatomic Potentials to Neural Networks for Predicting Material Properties

For decades, atomistic modeling has played a crucial role in predicting ...
research
09/12/2022

A framework for a generalisation analysis of machine-learned interatomic potentials

Machine-learned interatomic potentials (MLIPs) and force fields (i.e. in...
research
10/21/2019

Multiphase flow prediction with deep neural networks

This paper proposes a deep neural network approach for predicting multip...

Please sign up or login with your details

Forgot password? Click here to reset