DeepAI AI Chat
Log In Sign Up

Learning Deep Similarity Metric for 3D MR-TRUS Registration

by   Grant Haskins, et al.
Rensselaer Polytechnic Institute

Purpose: The fusion of transrectal ultrasound (TRUS) and magnetic resonance (MR) images for guiding targeted prostate biopsy has significantly improved the biopsy yield of aggressive cancers. A key component of MR-TRUS fusion is image registration. However, it is very challenging to obtain a robust automatic MR-TRUS registration due to the large appearance difference between the two imaging modalities. The work presented in this paper aims to tackle this problem by addressing two challenges: (i) the definition of a suitable similarity metric and (ii) the determination of a suitable optimization strategy. Methods: This work proposes the use of a deep convolutional neural network to learn a suitable similarity metric. We also use a composite optimization strategy to explore the solution space for optimizing the learned metric for image registration. Results: The learned similarity metric outperforms mutual information and the results indicate that the overall registration framework has a large capture range. The proposed deep similarity metric based approach obtained the mean TRE of 4.24mm (with an initial TRE of 16mm) for this challenging problem. Conclusion: Learned metric based on deep learning can be used to assess the quality of any given image registration and can be used in conjunction with the aforementioned optimization framework to perform automatic registration that is robust to poor initialization.


Adversarial Image Registration with Application for MR and TRUS Image Fusion

Robust and accurate alignment of multimodal medical images is a very cha...

A Deep Metric for Multimodal Registration

Multimodal registration is a challenging problem in medical imaging due ...

Motion correction of dynamic contrast enhanced MRI of the liver

Motion correction of dynamic contrast enhanced magnetic resonance images...

An Artificial Agent for Robust Image Registration

3-D image registration, which involves aligning two or more images, is a...

Variational Registration of Multiple Images with the SVD based SqN Distance Measure

Image registration, especially the quantification of image similarity, i...

HyperDense-Net: A densely connected CNN for multi-modal image segmentation

Neonatal brain segmentation in magnetic resonance (MR) is a challenging ...