Decision Tree Learning for Uncertain Clinical Measurements

07/25/2019
by   Cecília Nunes, et al.
0

Clinical decision requires reasoning in the presence of imperfect data. DTs are a well-known decision support tool, owing to their interpretability, fundamental in safety-critical contexts such as medical diagnosis. However, learning DTs from uncertain data leads to poor generalization, and generating predictions for uncertain data hinders prediction accuracy. Several methods have suggested the potential of probabilistic decisions at the internal nodes in making DTs robust to uncertainty. Some approaches only employ probabilistic thresholds during evaluation. Others also consider the uncertainty in the learning phase, at the expense of increased computational complexity or reduced interpretability. The existing methods have not clarified the merit of a probabilistic approach in the distinct phases of DT learning, nor when the uncertainty is present in the training or the test data. We present a probabilistic DT approach that models measurement uncertainty as a noise distribution, independently realized: (1) when searching for the split thresholds, (2) when splitting the training instances, and (3) when generating predictions for unseen data. The soft training approaches (1, 2) achieved a regularizing effect, leading to significant reductions in DT size, while maintaining accuracy, for increased noise. Soft evaluation (3) showed no benefit in handling noise.

READ FULL TEXT
research
09/12/2023

Identifying Bayesian Optimal Experiments for Uncertain Biochemical Pathway Models

Pharmacodynamic (PD) models are mathematical models of cellular reaction...
research
07/17/2019

Mitigating Uncertainty in Document Classification

The uncertainty measurement of classifiers' predictions is especially im...
research
02/11/2020

Fine-grained Uncertainty Modeling in Neural Networks

Existing uncertainty modeling approaches try to detect an out-of-distrib...
research
07/27/2021

A Tale Of Two Long Tails

As machine learning models are increasingly employed to assist human dec...
research
05/18/2021

Quantifying sources of uncertainty in drug discovery predictions with probabilistic models

Knowing the uncertainty in a prediction is critical when making expensiv...
research
06/20/2021

Uncertainty and Value of Perfect Information in Risk Prediction Modeling

Background: Predicted probabilities from a risk prediction model are ine...
research
04/06/2022

Fundamental limits to learning closed-form mathematical models from data

Given a finite and noisy dataset generated with a closed-form mathematic...

Please sign up or login with your details

Forgot password? Click here to reset