Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks

01/19/2021
by   Sven Koehler, et al.
9

Anisotropic multi-slice Cardiac Magnetic Resonance (CMR) Images are conventionally acquired in patient-specific short-axis (SAX) orientation. In specific cardiovascular diseases that affect right ventricular (RV) morphology, acquisitions in standard axial (AX) orientation are preferred by some investigators, due to potential superiority in RV volume measurement for treatment planning. Unfortunately, due to the rare occurrence of these diseases, data in this domain is scarce. Recent research in deep learning-based methods mainly focused on SAX CMR images and they had proven to be very successful. In this work, we show that there is a considerable domain shift between AX and SAX images, and therefore, direct application of existing models yield sub-optimal results on AX samples. We propose a novel unsupervised domain adaptation approach, which uses task-related probabilities in an attention mechanism. Beyond that, cycle consistency is imposed on the learned patient-individual 3D rigid transformation to improve stability when automatically re-sampling the AX images to SAX orientations. The network was trained on 122 registered 3D AX-SAX CMR volume pairs from a multi-centric patient cohort. A mean 3D Dice of 0.86±0.06 for the left ventricle, 0.65±0.08 for the myocardium, and 0.77±0.10 for the right ventricle could be achieved. This is an improvement of 25% in Dice for RV in comparison to direct application on axial slices. To conclude, our pre-trained task module has neither seen CMR images nor labels from the target domain, but is able to segment them after the domain gap is reduced. Code: https://github.com/Cardio-AI/3d-mri-domain-adaptation

READ FULL TEXT

page 1

page 2

page 3

page 7

page 8

page 9

page 11

page 12

research
09/13/2021

Unsupervised domain adaptation for cross-modality liver segmentation via joint adversarial learning and self-learning

Liver segmentation on images acquired using computed tomography (CT) and...
research
06/16/2021

Unsupervised Domain Adaptation with Variational Approximation for Cardiac Segmentation

Unsupervised domain adaptation is useful in medical image segmentation. ...
research
08/21/2019

Automated Multi-sequence Cardiac MRI Segmentation Using Supervised Domain Adaptation

Left ventricle segmentation and morphological assessment are essential f...
research
10/03/2018

A Comprehensive Approach for Learning-based Fully-Automated Inter-slice Motion Correction for Short-Axis Cine Cardiac MR Image Stacks

In the clinical routine, short axis (SA) cine cardiac MR (CMR) image sta...
research
11/24/2021

Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation

It is valuable to achieve domain adaptation to transfer the learned know...
research
12/14/2022

Unsupervised Domain Adaptation for Automated Knee Osteoarthritis Phenotype Classification

Purpose: The aim of this study was to demonstrate the utility of unsuper...
research
09/22/2021

The Impact of Domain Shift on Left and Right Ventricle Segmentation in Short Axis Cardiac MR Images

Domain shift refers to the difference in the data distribution of two da...

Please sign up or login with your details

Forgot password? Click here to reset