Addressing Artificial Intelligence Bias in Retinal Disease Diagnostics

04/28/2020
by   Philippe Burlina, et al.
7

Few studies of deep learning systems (DLS) have addressed issues of artificial intelligence bias for retinal diagnostics. This study evaluated novel AI and deep learning generative methods to address bias for retinal diagnostic applications when specifically applied to diabetic retinopathy (DR). A baseline DR diagnostics DLS designed to solve a two-class problem of referable vs not referable DR was applied to the public domain EyePACS dataset (88,692 fundi and 44,346 individuals), expanded to include clinician-annotated labels for race. Training data included diseased whites, healthy whites and healthy blacks, but lacked training exemplars for diseased blacks. Results: Accuracy (95 blacks of 60.5 P=.008) of AI performance as measured by accuracy across races. By contrast, an AI approach leveraging generative models was used to train a debiased diagnostic DLS with additional synthetic data for the missing subpopulation (diseased blacks), which achieved accuracy for whites of 77.5 and for blacks of 70.0 across races (Welch t-test t=1.70, P=.09). The debiased DLS also showed improvement in sensitivity of over 21 specificity, when compared with the baseline DLS. These findings demonstrate how data imbalance can lead to bias and inequality of accuracy depending on race, and illustrate the potential benefits of using novel generative methods for debiasing AI. Translational Relevance: These methods might decrease AI bias for other retinal and opthalmic diagnostic DLS.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 24

07/28/2020

Data, Power and Bias in Artificial Intelligence

Artificial Intelligence has the potential to exacerbate societal bias an...
12/11/2020

RENATA: REpreseNtation And Training Alteration for Bias Mitigation

We propose a novel method for enforcing AI fairness with respect to prot...
03/24/2020

Synergic Adversarial Label Learning with DR and AMD for Retinal Image Grading

The need for comprehensive and automated screening methods for retinal i...
03/15/2021

DiaRet: A browser-based application for the grading of Diabetic Retinopathy with Integrated Gradients

Diabetes is a metabolic disorder that results from defects in autoimmune...
09/23/2020

Docs are ROCs: A simple off-the-shelf approach for estimating average human performance in diagnostic studies

Estimating average human performance has been performed inconsistently i...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.