Optimal Transport Guided Unsupervised Learning for Enhancing low-quality Retinal Images

02/06/2023
by   Wenhui Zhu, et al.
0

Real-world non-mydriatic retinal fundus photography is prone to artifacts, imperfections and low-quality when certain ocular or systemic co-morbidities exist. Artifacts may result in inaccuracy or ambiguity in clinical diagnoses. In this paper, we proposed a simple but effective end-to-end framework for enhancing poor-quality retinal fundus images. Leveraging the optimal transport theory, we proposed an unpaired image-to-image translation scheme for transporting low-quality images to their high-quality counterparts. We theoretically proved that a Generative Adversarial Networks (GAN) model with a generator and discriminator is sufficient for this task. Furthermore, to mitigate the inconsistency of information between the low-quality images and their enhancements, an information consistency mechanism was proposed to maximally maintain structural consistency (optical discs, blood vessels, lesions) between the source and enhanced domains. Extensive experiments were conducted on the EyeQ dataset to demonstrate the superiority of our proposed method perceptually and quantitatively.

READ FULL TEXT

page 3

page 4

research
02/06/2023

OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing

Non-mydriatic retinal color fundus photography (CFP) is widely available...
research
11/27/2019

AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks

State-of-the-art methods in the unpaired image-to-image translation are ...
research
06/19/2021

Unbalanced Feature Transport for Exemplar-based Image Translation

Despite the great success of GANs in images translation with different c...
research
03/14/2020

Large-Scale Optimal Transport via Adversarial Training with Cycle-Consistency

Recent advances in large-scale optimal transport have greatly extended i...
research
02/28/2019

Two-phase Hair Image Synthesis by Self-Enhancing Generative Model

Generating plausible hair image given limited guidance, such as sparse s...
research
03/13/2023

Vessel-Promoted OCT to OCTA Image Translation by Heuristic Contextual Constraints

Optical Coherence Tomography Angiography (OCTA) has become increasingly ...
research
02/28/2022

Optimal Transport-based Graph Matching for 3D retinal OCT image registration

Registration of longitudinal optical coherence tomography (OCT) images a...

Please sign up or login with your details

Forgot password? Click here to reset