DeepOpht: Medical Report Generation for Retinal Images via Deep Models and Visual Explanation

11/01/2020
by   Jia-Hong Huang, et al.
0

In this work, we propose an AI-based method that intends to improve the conventional retinal disease treatment procedure and help ophthalmologists increase diagnosis efficiency and accuracy. The proposed method is composed of a deep neural networks-based (DNN-based) module, including a retinal disease identifier and clinical description generator, and a DNN visual explanation module. To train and validate the effectiveness of our DNN-based module, we propose a large-scale retinal disease image dataset. Also, as ground truth, we provide a retinal image dataset manually labeled by ophthalmologists to qualitatively show, the proposed AI-based method is effective. With our experimental results, we show that the proposed method is quantitatively and qualitatively effective. Our method is capable of creating meaningful retinal image descriptions and visual explanations that are clinically relevant.

READ FULL TEXT

page 5

page 7

page 8

research
05/30/2021

Longer Version for "Deep Context-Encoding Network for Retinal Image Captioning"

Automatically generating medical reports for retinal images is one of th...
research
06/24/2022

Feature Representation Learning for Robust Retinal Disease Detection from Optical Coherence Tomography Images

Ophthalmic images may contain identical-looking pathologies that can cau...
research
08/22/2022

Lirot.ai: A Novel Platform for Crowd-Sourcing Retinal Image Segmentations

Introduction: For supervised deep learning (DL) tasks, researchers need ...
research
12/06/2018

Pathological Evidence Exploration in Deep Retinal Image Diagnosis

Though deep learning has shown successful performance in classifying the...
research
08/09/2019

The Channel Attention based Context Encoder Network for Inner Limiting Membrane Detection

The optic disc segmentation is an important step for retinal image-based...
research
12/12/2016

Neural Networks with Manifold Learning for Diabetic Retinopathy Detection

Widespread outreach programs using remote retinal imaging have proven to...
research
06/02/2022

Comparing Conventional and Deep Feature Models for Classifying Fundus Photography of Hemorrhages

Diabetic retinopathy is an eye-related pathology creating abnormalities ...

Please sign up or login with your details

Forgot password? Click here to reset