DeepAI
Log In Sign Up

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

11/12/2020
by   Zhe Xu, et al.
0

Multimodal image registration (MIR) is a fundamental procedure in many image-guided therapies. Recently, unsupervised learning-based methods have demonstrated promising performance over accuracy and efficiency in deformable image registration. However, the estimated deformation fields of the existing methods fully rely on the to-be-registered image pair. It is difficult for the networks to be aware of the mismatched boundaries, resulting in unsatisfactory organ boundary alignment. In this paper, we propose a novel multimodal registration framework, which leverages the deformation fields estimated from both: (i) the original to-be-registered image pair, (ii) their corresponding gradient intensity maps, and adaptively fuses them with the proposed gated fusion module. With the help of auxiliary gradient-space guidance, the network can concentrate more on the spatial relationship of the organ boundary. Experimental results on two clinically acquired CT-MRI datasets demonstrate the effectiveness of our proposed approach.

READ FULL TEXT

page 1

page 4

07/06/2020

Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration

Deformable image registration between Computed Tomography (CT) images an...
02/13/2018

BIRNet: Brain Image Registration Using Dual-Supervised Fully Convolutional Networks

In this paper, we propose a deep learning approach for image registratio...
09/15/2020

F3RNet: Full-Resolution Residual Registration Network for Multimodal Image Registration

Multimodal deformable image registration is essential for many image-gui...
06/09/2021

PCNet: A Structure Similarity Enhancement Method for Multispectral and Multimodal Image Registration

Multispectral and multimodal image processing is important in the commun...
10/19/2021

Cross-Sim-NGF: FFT-Based Global Rigid Multimodal Alignment of Image Volumes using Normalized Gradient Fields

Multimodal image alignment involves finding spatial correspondences betw...
05/05/2021

Attention for Image Registration (AiR): an unsupervised Transformer approach

Image registration as an important basis in signal processing task often...
03/31/2017

Fast Predictive Multimodal Image Registration

We introduce a deep encoder-decoder architecture for image deformation p...