Heightmap Reconstruction of Macula on Color Fundus Images Using Conditional Generative Adversarial Networks

09/03/2020
by   Peyman Tahghighi, et al.
2

For medical diagnosis based on retinal images, a clear understanding of 3D structure is often required but due to the 2D nature of images captured, we cannot infer that information. However, by utilizing 3D reconstruction methods, we can construct the 3D structure of the macula area on fundus images which can be helpful for diagnosis and screening of macular disorders. Recent approaches have used shading information for 3D reconstruction or heightmap prediction but their output was not accurate since they ignored the dependency between nearby pixels. Additionally, other methods were dependent on the availability of more than one image of the eye which is not available in practice. In this paper, we use conditional generative adversarial networks (cGANs) to generate images that contain height information of the macula area on a fundus image. Results using our dataset show a 0.6077 improvement in Structural Similarity Index (SSIM) and 0.071 improvements in Mean Squared Error (MSE) metric over Shape from Shading (SFS) method. Additionally, Qualitative studies also indicate that our method outperforms recent approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 4

page 5

page 6

page 7

page 8

12/28/2020

Analysis of Macula on Color Fundus Images Using Heightmap Reconstruction Through Deep Learning

For medical diagnosis based on retinal images, a clear understanding of ...
06/18/2020

Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks

Fluorescein angiography can provide a map of retinal vascular structure ...
05/14/2020

Enhanced Residual Networks for Context-based Image Outpainting

Although humans perform well at predicting what exists beyond the bounda...
10/13/2020

Procedural 3D Terrain Generation using Generative Adversarial Networks

Procedural 3D Terrain generation has become a necessity in open world ga...
04/08/2017

Deep Generative Adversarial Compression Artifact Removal

Compression artifacts arise in images whenever a lossy compression algor...
04/04/2019

Accurate and Fast reconstruction of Porous Media from Extremely Limited Information Using Conditional Generative Adversarial Network

Porous media are ubiquitous in both nature and engineering applications,...
06/21/2017

cGAN-based Manga Colorization Using a Single Training Image

The Japanese comic format known as Manga is popular all over the world. ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.