DeepAI AI Chat
Log In Sign Up

Uncertainty Quantification Using Neural Networks for Molecular Property Prediction

05/20/2020
by   Lior Hirschfeld, et al.
MIT
25

Uncertainty quantification (UQ) is an important component of molecular property prediction, particularly for drug discovery applications where model predictions direct experimental design and where unanticipated imprecision wastes valuable time and resources. The need for UQ is especially acute for neural models, which are becoming increasingly standard yet are challenging to interpret. While several approaches to UQ have been proposed in the literature, there is no clear consensus on the comparative performance of these models. In this paper, we study this question in the context of regression tasks. We systematically evaluate several methods on five benchmark datasets using multiple complementary performance metrics. Our experiments show that none of the methods we tested is unequivocally superior to all others, and none produces a particularly reliable ranking of errors across multiple datasets. While we believe these results show that existing UQ methods are not sufficient for all common use-cases and demonstrate the benefits of further research, we conclude with a practical recommendation as to which existing techniques seem to perform well relative to others.

READ FULL TEXT

page 5

page 18

page 25

page 40

07/19/2023

Uncertainty Quantification for Molecular Property Predictions with Graph Neural Architecture Search

Graph Neural Networks (GNNs) have emerged as a prominent class of data-d...
06/26/2020

A Comparison of Uncertainty Estimation Approaches in Deep Learning Components for Autonomous Vehicle Applications

A key to ensuring safety in Autonomous Vehicles (AVs) is to avoid any ab...
03/20/2019

Uncertainty quantification of molecular property prediction with Bayesian neural networks

Deep neural networks have outperformed existing machine learning models ...
04/22/2020

Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithms

We present a comparison of methods for uncertainty quantification (UQ) i...
07/18/2023

PAC Neural Prediction Set Learning to Quantify the Uncertainty of Generative Language Models

Uncertainty learning and quantification of models are crucial tasks to e...
07/11/2023

Predicting small molecules solubilities on endpoint devices using deep ensemble neural networks

Aqueous solubility is a valuable yet challenging property to predict. Co...
03/06/2021

A Statistical Perspective on the Challenges in Molecular Microbial Biology

High throughput sequencing (HTS)-based technology enables identifying an...