Heightmap Reconstruction of Macula on Color Fundus Images Using Conditional Generative Adversarial Networks

by   Peyman Tahghighi, et al.

For medical diagnosis based on retinal images, a clear understanding of 3D structure is often required but due to the 2D nature of images captured, we cannot infer that information. However, by utilizing 3D reconstruction methods, we can construct the 3D structure of the macula area on fundus images which can be helpful for diagnosis and screening of macular disorders. Recent approaches have used shading information for 3D reconstruction or heightmap prediction but their output was not accurate since they ignored the dependency between nearby pixels. Additionally, other methods were dependent on the availability of more than one image of the eye which is not available in practice. In this paper, we use conditional generative adversarial networks (cGANs) to generate images that contain height information of the macula area on a fundus image. Results using our dataset show a 0.6077 improvement in Structural Similarity Index (SSIM) and 0.071 improvements in Mean Squared Error (MSE) metric over Shape from Shading (SFS) method. Additionally, Qualitative studies also indicate that our method outperforms recent approaches.



There are no comments yet.


page 1

page 3

page 4

page 5

page 6

page 7

page 8


Analysis of Macula on Color Fundus Images Using Heightmap Reconstruction Through Deep Learning

For medical diagnosis based on retinal images, a clear understanding of ...

Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks

Fluorescein angiography can provide a map of retinal vascular structure ...

Enhanced Residual Networks for Context-based Image Outpainting

Although humans perform well at predicting what exists beyond the bounda...

Procedural 3D Terrain Generation using Generative Adversarial Networks

Procedural 3D Terrain generation has become a necessity in open world ga...

Deep Generative Adversarial Compression Artifact Removal

Compression artifacts arise in images whenever a lossy compression algor...

Accurate and Fast reconstruction of Porous Media from Extremely Limited Information Using Conditional Generative Adversarial Network

Porous media are ubiquitous in both nature and engineering applications,...

cGAN-based Manga Colorization Using a Single Training Image

The Japanese comic format known as Manga is popular all over the world. ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.