BenchML: an extensible pipelining framework for benchmarking representations of materials and molecules at scale

12/04/2021
by   Carl Poelking, et al.
0

We introduce a machine-learning (ML) framework for high-throughput benchmarking of diverse representations of chemical systems against datasets of materials and molecules. The guiding principle underlying the benchmarking approach is to evaluate raw descriptor performance by limiting model complexity to simple regression schemes while enforcing best ML practices, allowing for unbiased hyperparameter optimization, and assessing learning progress through learning curves along series of synchronized train-test splits. The resulting models are intended as baselines that can inform future method development, next to indicating how easily a given dataset can be learnt. Through a comparative analysis of the training outcome across a diverse set of physicochemical, topological and geometric representations, we glean insight into the relative merits of these representations as well as their interrelatedness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2018

Learning representations of molecules and materials with atomistic neural networks

Deep Learning has been shown to learn efficient representations for stru...
research
04/29/2019

Challenges and Pitfalls of Machine Learning Evaluation and Benchmarking

An increasingly complex and diverse collection of Machine Learning (ML) ...
research
01/28/2018

Less is more: sampling chemical space with active learning

The development of accurate and transferable machine learning (ML) poten...
research
01/10/2019

A Universal Density Matrix Functional from Molecular Orbital-Based Machine Learning: Transferability across Organic Molecules

We address the degree to which machine learning can be used to accuratel...
research
07/11/2020

Crystal Structure Representations for Machine Learning Models of Formation Energies

We introduce and evaluate a set of feature vector representations of cry...
research
10/11/2022

Vote'n'Rank: Revision of Benchmarking with Social Choice Theory

The development of state-of-the-art systems in different applied areas o...

Please sign up or login with your details

Forgot password? Click here to reset