Pseudo Bias-Balanced Learning for Debiased Chest X-ray Classification

03/18/2022
by   Luyang Luo, et al.
0

Deep learning models were frequently reported to learn from shortcuts like dataset biases. As deep learning is playing an increasingly important role in the modern healthcare system, it is of great need to combat shortcut learning in medical data as well as develop unbiased and trustworthy models. In this paper, we study the problem of developing debiased chest X-ray diagnosis models from the biased training data without knowing exactly the bias labels. We start with the observations that the imbalance of bias distribution is one of the key reasons causing shortcut learning, and the dataset biases are preferred by the model if they were easier to be learned than the intended features. Based on these observations, we propose a novel algorithm, pseudo bias-balanced learning, which first captures and predicts per-sample bias labels via generalized cross entropy loss and then trains a debiased model using pseudo bias labels and bias-balanced softmax function. To our best knowledge, we are pioneered in tackling dataset biases in medical images without explicit labeling on the bias attributes. We constructed several chest X-ray datasets with various dataset bias situations and demonstrated with extensive experiments that our proposed method achieved consistent improvements over other state-of-the-art approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2022

Unsupervised Learning of Unbiased Visual Representations

Deep neural networks are known for their inability to learn robust repre...
research
02/07/2020

Quantifying the Value of Lateral Views in Deep Learning for Chest X-rays

Most deep learning models in chest X-ray prediction utilize the posteroa...
research
12/02/2020

Learning from others' mistakes: Avoiding dataset biases without modeling them

State-of-the-art natural language processing (NLP) models often learn to...
research
09/19/2020

Bias Field Poses a Threat to DNN-based X-Ray Recognition

The chest X-ray plays a key role in screening and diagnosis of many lung...
research
09/07/2022

Risk of Bias in Chest X-ray Foundation Models

Foundation models are considered a breakthrough in all applications of A...
research
12/27/2021

Multi-Domain Balanced Sampling Improves Out-of-Distribution Generalization of Chest X-ray Pathology Prediction Models

Learning models that generalize under different distribution shifts in m...

Please sign up or login with your details

Forgot password? Click here to reset