Towards a Foundation Model for Neural Network Wavefunctions

03/17/2023
by   Michael Scherbela, et al.
0

Deep neural networks have become a highly accurate and powerful wavefunction ansatz in combination with variational Monte Carlo methods for solving the electronic Schrödinger equation. However, despite their success and favorable scaling, these methods are still computationally too costly for wide adoption. A significant obstacle is the requirement to optimize the wavefunction from scratch for each new system, thus requiring long optimization. In this work, we propose a novel neural network ansatz, which effectively maps uncorrelated, computationally cheap Hartree-Fock orbitals, to correlated, high-accuracy neural network orbitals. This ansatz is inherently capable of learning a single wavefunction across multiple compounds and geometries, as we demonstrate by successfully transferring a wavefunction model pre-trained on smaller fragments to larger compounds. Furthermore, we provide ample experimental evidence to support the idea that extensive pre-training of a such a generalized wavefunction model across different compounds and geometries could lead to a foundation wavefunction model. Such a model could yield high-accuracy ab-initio energies using only minimal computational effort for fine-tuning and evaluation of observables.

READ FULL TEXT

page 4

page 18

research
05/18/2021

Solving the electronic Schrödinger equation for multiple nuclear geometries with weight-sharing deep neural networks

Accurate numerical solutions for the Schrödinger equation are of utmost ...
research
03/17/2022

Electronic excited states in deep variational Monte Carlo

Obtaining accurate ground and low-lying excited states of electronic sys...
research
01/05/2023

StitchNet: Composing Neural Networks from Pre-Trained Fragments

We propose StitchNet, a novel neural network creation paradigm that stit...
research
07/15/2023

Variational Monte Carlo on a Budget – Fine-tuning pre-trained Neural Wavefunctions

Obtaining accurate solutions to the Schrödinger equation is the key chal...
research
09/14/2023

When is a Foundation Model a Foundation Model

Recently, several studies have reported on the fine-tuning of foundation...
research
12/07/2021

Explicitly antisymmetrized neural network layers for variational Monte Carlo simulation

The combination of neural networks and quantum Monte Carlo methods has a...
research
11/18/2015

Net2Net: Accelerating Learning via Knowledge Transfer

We introduce techniques for rapidly transferring the information stored ...

Please sign up or login with your details

Forgot password? Click here to reset