Vessel-Promoted OCT to OCTA Image Translation by Heuristic Contextual Constraints

03/13/2023
by   Shuhan LI, et al.
0

Optical Coherence Tomography Angiography (OCTA) has become increasingly vital in the clinical screening of fundus diseases due to its ability to capture accurate 3D imaging of blood vessels in a non-contact scanning manner. However, the acquisition of OCTA images remains challenging due to the requirement of exclusive sensors and expensive devices. In this paper, we propose a novel framework, TransPro, that translates 3D Optical Coherence Tomography (OCT) images into exclusive 3D OCTA images using an image translation pattern. Our main objective is to address two issues in existing image translation baselines, namely, the aimlessness in the translation process and incompleteness of the translated object. The former refers to the overall quality of the translated OCTA images being satisfactory, but the retinal vascular quality being low. The latter refers to incomplete objects in translated OCTA images due to the lack of global contexts. TransPro merges a 2D retinal vascular segmentation model and a 2D OCTA image translation model into a 3D image translation baseline for the 2D projection map projected by the translated OCTA images. The 2D retinal vascular segmentation model can improve attention to the retinal vascular, while the 2D OCTA image translation model introduces beneficial heuristic contextual information. Extensive experimental results on two challenging datasets demonstrate that TransPro can consistently outperform existing approaches with minimal computational overhead during training and none during testing.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 8

research
12/11/2021

Unsupervised Image to Image Translation for Multiple Retinal Pathology Synthesis in Optical Coherence Tomography Scans

Image to Image Translation (I2I) is a challenging computer vision proble...
research
10/07/2019

Noise as Domain Shift: Denoising Medical Images by Unpaired Image Translation

We cast the problem of image denoising as a domain translation problem b...
research
02/06/2023

OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing

Non-mydriatic retinal color fundus photography (CFP) is widely available...
research
12/03/2021

Panoptic-based Object Style-Align for Image-to-Image Translation

Despite remarkable recent progress in image translation, the complex sce...
research
07/09/2023

Latent Graph Attention for Enhanced Spatial Context

Global contexts in images are quite valuable in image-to-image translati...
research
02/06/2023

Optimal Transport Guided Unsupervised Learning for Enhancing low-quality Retinal Images

Real-world non-mydriatic retinal fundus photography is prone to artifact...
research
05/14/2022

Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variable

We propose Mask CycleGAN, a novel architecture for unpaired image domain...

Please sign up or login with your details

Forgot password? Click here to reset