Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy

10/04/2017
by   Jonathan Krause, et al.
0

Diabetic retinopathy (DR) and diabetic macular edema are common complications of diabetes which can lead to vision loss. The grading of DR is a fairly complex process that requires the detection of fine features such as microaneurysms, intraretinal hemorrhages, and intraretinal microvascular abnormalities. Because of this, there can be a fair amount of grader variability. There are different methods of obtaining the reference standard and resolving disagreements between graders, and while it is usually accepted that adjudication until full consensus will yield the best reference standard, the difference between various methods of resolving disagreements has not been examined extensively. In this study, we examine the variability in different methods of grading, definitions of reference standards, and their effects on building deep learning models for the detection of diabetic eye disease. We find that a small set of adjudicated DR grades allows substantial improvements in algorithm performance. The resulting algorithm's performance was on par with that of individual U.S. board-certified ophthalmologists and retinal specialists.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/18/2018

Deep Learning vs. Human Graders for Classifying Severity Levels of Diabetic Retinopathy in a Real-World Nationwide Screening Program

Deep learning algorithms have been used to detect diabetic retinopathy (...
research
10/29/2020

Sea-Net: Squeeze-And-Excitation Attention Net For Diabetic Retinopathy Grading

Diabetes is one of the most common disease in individuals. Diabetic reti...
research
06/22/2021

Diabetic Retinopathy Detection using Ensemble Machine Learning

Diabetic Retinopathy (DR) is among the worlds leading vision loss causes...
research
08/15/2021

Two Eyes Are Better Than One: Exploiting Binocular Correlation for Diabetic Retinopathy Severity Grading

Diabetic retinopathy (DR) is one of the most common eye conditions among...
research
12/13/2022

Interpretable Diabetic Retinopathy Diagnosis based on Biomarker Activation Map

Deep learning classifiers provide the most accurate means of automatical...

Please sign up or login with your details

Forgot password? Click here to reset