Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images using Weakly-Supervised Joint Convolutional Sparse Coding

05/07/2017
by   Yawen Huang, et al.
0

Magnetic Resonance Imaging (MRI) offers high-resolution in vivo imaging and rich functional and anatomical multimodality tissue contrast. In practice, however, there are challenges associated with considerations of scanning costs, patient comfort, and scanning time that constrain how much data can be acquired in clinical or research studies. In this paper, we explore the possibility of generating high-resolution and multimodal images from low-resolution single-modality imagery. We propose the weakly-supervised joint convolutional sparse coding to simultaneously solve the problems of super-resolution (SR) and cross-modality image synthesis. The learning process requires only a few registered multimodal image pairs as the training set. Additionally, the quality of the joint dictionary learning can be improved using a larger set of unpaired images. To combine unpaired data from different image resolutions/modalities, a hetero-domain image alignment term is proposed. Local image neighborhoods are naturally preserved by operating on the whole image domain (as opposed to image patches) and using joint convolutional sparse coding. The paired images are enhanced in the joint learning process with unpaired data and an additional maximum mean discrepancy term, which minimizes the dissimilarity between their feature distributions. Experiments show that the proposed method outperforms state-of-the-art techniques on both SR reconstruction and simultaneous SR and cross-modality synthesis.

READ FULL TEXT

page 4

page 7

page 8

research
09/07/2020

Interpretable Deep Multimodal Image Super-Resolution

Multimodal image super-resolution (SR) is the reconstruction of a high r...
research
01/23/2022

Perceptual cGAN for MRI Super-resolution

Capturing high-resolution magnetic resonance (MR) images is a time consu...
research
08/07/2018

Deep Learning Super-Resolution Enables Rapid Simultaneous Morphological and Quantitative Magnetic Resonance Imaging

Obtaining magnetic resonance images (MRI) with high resolution and gener...
research
02/13/2019

Super-Resolution of Brain MRI Images using Overcomplete Dictionaries and Nonlocal Similarity

Recently, the Magnetic Resonance Imaging (MRI) images have limited and u...
research
06/15/2017

DOTE: Dual cOnvolutional filTer lEarning for Super-Resolution and Cross-Modality Synthesis in MRI

Cross-modal image synthesis is a topical problem in medical image comput...
research
04/21/2020

Weakly Aligned Joint Cross-Modality Super Resolution

Non-visual imaging sensors are widely used in the industry for different...
research
03/02/2017

Estimating the resolution of real images

Image resolvability is the primary concern in imaging. This paper report...

Please sign up or login with your details

Forgot password? Click here to reset