Risk of Training Diagnostic Algorithms on Data with Demographic Bias

One of the critical challenges in machine learning applications is to have fair predictions. There are numerous recent examples in various domains that convincingly show that algorithms trained with biased datasets can easily lead to erroneous or discriminatory conclusions. This is even more crucial in clinical applications where the predictive algorithms are designed mainly based on a limited or given set of medical images and demographic variables such as age, sex and race are not taken into account. In this work, we conduct a survey of the MICCAI 2018 proceedings to investigate the common practice in medical image analysis applications. Surprisingly, we found that papers focusing on diagnosis rarely describe the demographics of the datasets used, and the diagnosis is purely based on images. In order to highlight the importance of considering the demographics in diagnosis tasks, we used a publicly available dataset of skin lesions. We then demonstrate that a classifier with an overall area under the curve (AUC) of 0.83 has variable performance between 0.76 and 0.91 on subgroups based on age and sex, even though the training set was relatively balanced. Moreover, we show that it is possible to learn unbiased features by explicitly using demographic variables in an adversarial training setup, which leads to balanced scores per subgroups. Finally, we discuss the implications of these results and provide recommendations for further research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2023

Adversarial Attack and Defense for Medical Image Analysis: Methods and Applications

Deep learning techniques have achieved superior performance in computer-...
research
12/13/2022

Adversarial Attacks and Defences for Skin Cancer Classification

There has been a concurrent significant improvement in the medical image...
research
07/13/2022

Deep Learning Discovery of Demographic Biomarkers in Echocardiography

Deep learning has been shown to accurately assess 'hidden' phenotypes an...
research
02/05/2021

Machine Learning Applications on Neuroimaging for Diagnosis and Prognosis of Epilepsy: A Review

Machine learning is playing an increasing important role in medical imag...
research
10/08/2019

Bias-Resilient Neural Network

Presence of bias and confounding effects is inarguably one of the most c...
research
05/09/2023

Towards unraveling calibration biases in medical image analysis

In recent years the development of artificial intelligence (AI) systems ...
research
09/11/2020

Medical Selfies: Emotional Impacts and Practical Challenges

Medical images taken with mobile phones by patients, i.e. medical selfie...

Please sign up or login with your details

Forgot password? Click here to reset