Metrics for Benchmarking and Uncertainty Quantification: Quality, Applicability, and a Path to Best Practices for Machine Learning in Chemistry

09/30/2020
by   Gaurav Vishwakarma, et al.
0

This review aims to draw attention to two issues of concern when we set out to make machine learning work in the chemical and materials domain, i.e., statistical loss function metrics for the validation and benchmarking of data-derived models, and the uncertainty quantification of predictions made by them. They are often overlooked or underappreciated topics as chemists typically only have limited training in statistics. Aside from helping to assess the quality, reliability, and applicability of a given model, these metrics are also key to comparing the performance of different models and thus for developing guidelines and best practices for the successful application of machine learning in chemistry.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2023

Validation of uncertainty quantification metrics: a primer based on the consistency and adaptivity concepts

The practice of uncertainty quantification (UQ) validation, notably in m...
research
10/30/2022

A view on model misspecification in uncertainty quantification

Estimating uncertainty of machine learning models is essential to assess...
research
12/04/2021

BenchML: an extensible pipelining framework for benchmarking representations of materials and molecules at scale

We introduce a machine-learning (ML) framework for high-throughput bench...
research
05/02/2023

Single-model uncertainty quantification in neural network potentials does not consistently outperform model ensembles

Neural networks (NNs) often assign high confidence to their predictions,...
research
12/05/2017

The Role of Data Analysis in Uncertainty Quantification: Case Studies for Materials Modeling

In computational materials science, mechanical properties are typically ...
research
08/23/2022

Building Robust Machine Learning Models for Small Chemical Science Data: The Case of Shear Viscosity

Shear viscosity, though being a fundamental property of all liquids, is ...

Please sign up or login with your details

Forgot password? Click here to reset