Cross-Modality Multi-Atlas Segmentation Using Deep Neural Networks

08/15/2020
by   Wangbin Ding, et al.
2

Both image registration and label fusion in the multi-atlas segmentation (MAS) rely on the intensity similarity between target and atlas images. However, such similarity can be problematic when target and atlas images are acquired using different imaging protocols. High-level structure information can provide reliable similarity measurement for cross-modality images when cooperating with deep neural networks (DNNs). This work presents a new MAS framework for cross-modality images, where both image registration and label fusion are achieved by DNNs. For image registration, we propose a consistent registration network, which can jointly estimate forward and backward dense displacement fields (DDFs). Additionally, an invertible constraint is employed in the network to reduce the correspondence ambiguity of the estimated DDFs. For label fusion, we adapt a few-shot learning network to measure the similarity of atlas and target patches. Moreover, the network can be seamlessly integrated into the patch-based label fusion. The proposed framework is evaluated on the MM-WHS dataset of MICCAI 2017. Results show that the framework is effective in both cross-modality registration and segmentation.

READ FULL TEXT
research
06/28/2020

MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation

Current deep-learning-based registration algorithms often exploit intens...
research
05/24/2022

Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration

Recent learning-based image fusion methods have marked numerous progress...
research
05/16/2021

Unsupervised MMRegNet based on Spatially Encoded Gradient Information

Multi-modality medical images can provide relevant and complementary ana...
research
12/19/2015

Combining patch-based strategies and non-rigid registration-based label fusion methods

The objective of this study is to develop a patch-based labeling method ...
research
11/01/2019

VoteNet+ : An Improved Deep Learning Label Fusion Method for Multi-atlas Segmentation

In this work, we improve the performance of multi-atlas segmentation (MA...
research
06/27/2022

ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration

Establishing voxelwise semantic correspondence across distinct imaging m...
research
10/06/2019

Which Ads to Show? Advertisement Image Assessment with Auxiliary Information via Multi-step Modality Fusion

Assessing aesthetic preference is a fundamental task related to human co...

Please sign up or login with your details

Forgot password? Click here to reset