Better, Faster Fermionic Neural Networks

11/13/2020
by   James S. Spencer, et al.
0

The Fermionic Neural Network (FermiNet) is a recently-developed neural network architecture that can be used as a wavefunction Ansatz for many-electron systems, and has already demonstrated high accuracy on small systems. Here we present several improvements to the FermiNet that allow us to set new records for speed and accuracy on challenging systems. We find that increasing the size of the network is sufficient to reach chemical accuracy on atoms as large as argon. Through a combination of implementing FermiNet in JAX and simplifying several parts of the network, we are able to reduce the number of GPU hours needed to train the FermiNet on large systems by an order of magnitude. This enables us to run the FermiNet on the challenging transition of bicyclobutane to butadiene and compare against the PauliNet on the automerization of cyclobutadiene, and we achieve results near the state of the art for both.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2018

TAPAS: Train-less Accuracy Predictor for Architecture Search

In recent years an increasing number of researchers and practitioners ha...
research
04/21/2017

Learned D-AMP: Principled Neural Network based Compressive Image Recovery

Compressive image recovery is a challenging problem that requires fast a...
research
09/26/2019

Exascale Deep Learning to Accelerate Cancer Research

Deep learning, through the use of neural networks, has demonstrated rema...
research
06/07/2016

ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation

The ability to perform pixel-wise semantic segmentation in real-time is ...
research
03/07/2017

NoScope: Optimizing Neural Network Queries over Video at Scale

Recent advances in computer vision-in the form of deep neural networks-h...
research
01/26/2019

Efficient Toxicity Prediction via Simple Features Using Shallow Neural Networks and Decision Trees

Toxicity prediction of chemical compounds is a grand challenge. Lately, ...
research
08/16/2019

FiFTy: Large-scale File Fragment Type Identification using Neural Networks

We present FiFTy, a modern file type identification tool for memory fore...

Please sign up or login with your details

Forgot password? Click here to reset