DeepAI AI Chat
Log In Sign Up

A critical assessment of conformal prediction methods applied in binary classification settings

by   Damjan Krstajic, et al.

In recent years there has been an increase in the number of scientific papers that suggest using conformal predictions in drug discovery. We consider that some versions of conformal predictions applied in binary settings are embroiled in pitfalls, not obvious at first sight, and that it is important to inform the scientific community about them. In the paper we first introduce the general theory of conformal predictions and follow with an explanation of the versions currently dominant in drug discovery research today. Finally, we provide cases for their critical assessment in binary classification settings.


page 1

page 2

page 3

page 4


Concepts and Applications of Conformal Prediction in Computational Drug Discovery

Estimating the reliability of individual predictions is key to increase ...

Graph-augmented Convolutional Networks on Drug-Drug Interactions Prediction

We propose an end-to-end model to predict drug-drug interactions (DDIs) ...

A Systematic Assessment of Deep Learning Models for Molecule Generation

In recent years the scientific community has devoted much effort in the ...

On the relation between accuracy and fairness in binary classification

Our study revisits the problem of accuracy-fairness tradeoff in binary c...

Scientific Discovery by Generating Counterfactuals using Image Translation

Model explanation techniques play a critical role in understanding the s...

Generalization for multiclass classification with overparameterized linear models

Via an overparameterized linear model with Gaussian features, we provide...