Contrastive Learning MRI Reconstruction

06/01/2023
by   Mevan Ekanayake, et al.
0

Purpose: We propose a novel contrastive learning latent space representation for MRI datasets with partially acquired scans. We show that this latent space can be utilized for accelerated MR image reconstruction. Theory and Methods: Our novel framework, referred to as COLADA (stands for Contrastive Learning for highly accelerated MR image reconstruction), maximizes the mutual information between differently accelerated images of an MRI scan by using self-supervised contrastive learning. In other words, it attempts to "pull" the latent representations of the same scan together and "push" the latent representations of other scans away. The generated MRI latent space is subsequently utilized for MR image reconstruction and the performance was assessed in comparison to several baseline deep learning reconstruction methods. Furthermore, the quality of the proposed latent space representation was analyzed using Alignment and Uniformity. Results: COLADA comprehensively outperformed other reconstruction methods with robustness to variations in undersampling patterns, pathological abnormalities, and noise in k-space during inference. COLADA proved the high quality of reconstruction on unseen data with minimal fine-tuning. The analysis of representation quality suggests that the contrastive features produced by COLADA are optimally distributed in latent space. Conclusion: To the best of our knowledge, this is the first attempt to utilize contrastive learning on differently accelerated images for MR image reconstruction. The proposed latent space representation has practical usage due to a large number of existing partially sampled datasets. This implies the possibility of exploring self-supervised contrastive learning further to enhance the latent space of MRI for image reconstruction.

READ FULL TEXT

page 16

page 17

page 18

page 20

page 21

page 22

page 23

page 29

research
11/24/2022

Iterative Data Refinement for Self-Supervised MR Image Reconstruction

Magnetic Resonance Imaging (MRI) has become an important technique in th...
research
03/18/2022

Rethinking the optimization process for self-supervised model-driven MRI reconstruction

Recovering high-quality images from undersampled measurements is critica...
research
07/29/2021

Deep Quantized Representation for Enhanced Reconstruction

While machine learning approaches have shown remarkable performance in b...
research
10/19/2021

Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAE

Wasserstein autoencoder (WAE) shows that matching two distributions is e...
research
02/25/2023

Raw Image Reconstruction with Learned Compact Metadata

While raw images exhibit advantages over sRGB images (e.g., linearity an...
research
08/26/2022

A Path Towards Clinical Adaptation of Accelerated MRI

Accelerated MRI reconstructs images of clinical anatomies from sparsely ...
research
03/05/2019

Improving Generalization of Deep Networks for Inverse Reconstruction of Image Sequences

Deep learning networks have shown state-of-the-art performance in many i...

Please sign up or login with your details

Forgot password? Click here to reset