A critical assessment of conformal prediction methods applied in binary classification settings

08/23/2020
by   Damjan Krstajic, et al.
0

In recent years there has been an increase in the number of scientific papers that suggest using conformal predictions in drug discovery. We consider that some versions of conformal predictions applied in binary settings are embroiled in pitfalls, not obvious at first sight, and that it is important to inform the scientific community about them. In the paper we first introduce the general theory of conformal predictions and follow with an explanation of the versions currently dominant in drug discovery research today. Finally, we provide cases for their critical assessment in binary classification settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/09/2019

Concepts and Applications of Conformal Prediction in Computational Drug Discovery

Estimating the reliability of individual predictions is key to increase ...
research
12/08/2019

Graph-augmented Convolutional Networks on Drug-Drug Interactions Prediction

We propose an end-to-end model to predict drug-drug interactions (DDIs) ...
research
08/20/2020

A Systematic Assessment of Deep Learning Models for Molecule Generation

In recent years the scientific community has devoted much effort in the ...
research
05/21/2015

On the relation between accuracy and fairness in binary classification

Our study revisits the problem of accuracy-fairness tradeoff in binary c...
research
01/21/2020

Missed opportunities in large scale comparison of QSAR and conformal prediction methods and their applications in drug discovery

Recently Bosc et al. (J Cheminform 11(1): 4, 2019), published an article...
research
07/10/2020

Scientific Discovery by Generating Counterfactuals using Image Translation

Model explanation techniques play a critical role in understanding the s...
research
11/27/2017

Binary classification models with "Uncertain" predictions

Binary classification models which can assign probabilities to categorie...

Please sign up or login with your details

Forgot password? Click here to reset