Conditional Segmentation in Lieu of Image Registration

06/30/2019
by   Yipeng Hu, et al.
0

Classical pairwise image registration methods search for a spatial transformation that optimises a numerical measure that indicates how well a pair of moving and fixed images are aligned. Current learning-based registration methods have adopted the same paradigm and typically predict, for any new input image pair, dense correspondences in the form of a dense displacement field or parameters of a spatial transformation model. However, in many applications of registration, the spatial transformation itself is only required to propagate points or regions of interest (ROIs). In such cases, detailed pixel- or voxel-level correspondence within or outside of these ROIs often have little clinical value. In this paper, we propose an alternative paradigm in which the location of corresponding image-specific ROIs, defined in one image, within another image is learnt. This results in replacing image registration by a conditional segmentation algorithm, which can build on typical image segmentation networks and their widely-adopted training strategies. Using the registration of 3D MRI and ultrasound images of the prostate as an example to demonstrate this new approach, we report a median target registration error (TRE) of 2.1 mm between the ground-truth ROIs defined on intraoperative ultrasound images and those propagated from the preoperative MR images. Significantly lower (>34 conditional segmentation compared with those obtained from a previously-proposed spatial-transformation-predicting registration network trained with the same multiple ROI labels for individual image pairs. We conclude this work by using a quantitative bias-variance analysis to provide one explanation of the observed improvement in registration accuracy.

READ FULL TEXT
research
07/09/2018

Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registration

One of the fundamental challenges in supervised learning for multimodal ...
research
06/28/2020

MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation

Current deep-learning-based registration algorithms often exploit intens...
research
03/12/2023

Spatial Correspondence between Graph Neural Network-Segmented Images

Graph neural networks (GNNs) have been proposed for medical image segmen...
research
07/22/2019

Image-and-Spatial Transformer Networks for Structure-Guided Image Registration

Image registration with deep neural networks has become an active field ...
research
11/05/2017

Label-driven weakly-supervised learning for multimodal deformable image registration

Spatially aligning medical images from different modalities remains a ch...
research
02/08/2016

Multimodal Remote Sensing Image Registration with Accuracy Estimation at Local and Global Scales

This paper focuses on potential accuracy of remote sensing images regist...
research
02/24/2020

Evaluating Registration Without Ground Truth

We present a generic method for assessing the quality of non-rigid regis...

Please sign up or login with your details

Forgot password? Click here to reset