Learn Single-horizon Disease Evolution for Predictive Generation of Post-therapeutic Neovascular Age-related Macular Degeneration

08/12/2023
by   Yuhan Zhang, et al.
0

Most of the existing disease prediction methods in the field of medical image processing fall into two classes, namely image-to-category predictions and image-to-parameter predictions. Few works have focused on image-to-image predictions. Different from multi-horizon predictions in other fields, ophthalmologists prefer to show more confidence in single-horizon predictions due to the low tolerance of predictive risk. We propose a single-horizon disease evolution network (SHENet) to predictively generate post-therapeutic SD-OCT images by inputting pre-therapeutic SD-OCT images with neovascular age-related macular degeneration (nAMD). In SHENet, a feature encoder converts the input SD-OCT images to deep features, then a graph evolution module predicts the process of disease evolution in high-dimensional latent space and outputs the predicted deep features, and lastly, feature decoder recovers the predicted deep features to SD-OCT images. We further propose an evolution reinforcement module to ensure the effectiveness of disease evolution learning and obtain realistic SD-OCT images by adversarial training. SHENet is validated on 383 SD-OCT cubes of 22 nAMD patients based on three well-designed schemes based on the quantitative and qualitative evaluations. Compared with other generative methods, the generative SD-OCT images of SHENet have the highest image quality. Besides, SHENet achieves the best structure protection and content prediction. Qualitative evaluations also demonstrate that SHENet has a better visual effect than other methods. SHENet can generate post-therapeutic SD-OCT images with both high prediction performance and good image quality, which has great potential to help ophthalmologists forecast the therapeutic effect of nAMD.

READ FULL TEXT

page 3

page 18

page 24

research
06/12/2019

Stereoscopic Omnidirectional Image Quality Assessment Based on Predictive Coding Theory

Objective quality assessment of stereoscopic omnidirectional images is a...
research
02/15/2018

Evolution of Images with Diversity and Constraints Using a Generator Network

Evolutionary search has been extensively used to generate artistic image...
research
08/03/2022

Counterfactual Image Synthesis for Discovery of Personalized Predictive Image Markers

The discovery of patient-specific imaging markers that are predictive of...
research
01/31/2020

Unsupervised deep clustering for predictive texture pattern discovery in medical images

Predictive marker patterns in imaging data are a means to quantify disea...
research
01/19/2021

Using StyleGAN for Visual Interpretability of Deep Learning Models on Medical Images

As AI-based medical devices are becoming more common in imaging fields l...
research
05/12/2022

Deep Decomposition and Bilinear Pooling Network for Blind Night-Time Image Quality Evaluation

Blind image quality assessment (BIQA), which aims to accurately predict ...

Please sign up or login with your details

Forgot password? Click here to reset