One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipeline

05/14/2021
by   Zhiwen Wang, et al.
0

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmentation are usually processed independently in the conventional practice of MRI workflow. It is easy to notice that there are significant relevances among these tasks and this procedure artificially cuts off these potential connections, which may lead to losing clinically important information for the final diagnosis. To involve these potential relations for further performance improvement, a sequential multi-task joint learning network model is proposed to train a combined end-to-end pipeline in a differentiable way, aiming at exploring the mutual influence among those tasks simultaneously. Our design consists of three cascaded modules: 1) deep sampling pattern learning module optimizes the k-space sampling pattern with predetermined sampling rate; 2) deep reconstruction module is dedicated to reconstructing MR images from the undersampled data using the learned sampling pattern; 3) deep segmentation module encodes MR images reconstructed from the previous module to segment the interested tissues. The proposed model retrieves the latently interactive and cyclic relations among those tasks, from which each task will be mutually beneficial. The proposed framework is verified on MRB dataset, which achieves superior performance on other SOTA methods in terms of both reconstruction and segmentation.

READ FULL TEXT

page 5

page 6

page 7

page 11

research
10/22/2022

JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI

Multi-contrast Magnetic Resonance Imaging (MRI) generates multiple medic...
research
05/13/2021

End-to-End Sequential Sampling and Reconstruction for MR Imaging

Accelerated MRI shortens acquisition time by subsampling in the measurem...
research
11/27/2020

Multi-task MR Imaging with Iterative Teacher Forcing and Re-weighted Deep Learning

Noises, artifacts, and loss of information caused by the magnetic resona...
research
11/11/2021

Fast T2w/FLAIR MRI Acquisition by Optimal Sampling of Information Complementary to Pre-acquired T1w MRI

Recent studies on T1-assisted MRI reconstruction for under-sampled image...
research
02/01/2021

Reconstruction and Segmentation of Parallel MR Data using Image Domain DEEP-SLR

The main focus of this work is a novel framework for the joint reconstru...
research
05/14/2022

A Unifying Multi-sampling-ratio CS-MRI Framework With Two-grid-cycle Correction and Geometric Prior Distillation

CS is an efficient method to accelerate the acquisition of MR images fro...
research
11/11/2022

Multitask Learning for Improved Late Mechanical Activation Detection of Heart from Cine DENSE MRI

The selection of an optimal pacing site, which is ideally scar-free and ...

Please sign up or login with your details

Forgot password? Click here to reset