Adversarial optimization for joint registration and segmentation in prostate CT radiotherapy

by   Mohamed S. Elmahdy, et al.

Joint image registration and segmentation has long been an active area of research in medical imaging. Here, we reformulate this problem in a deep learning setting using adversarial learning. We consider the case in which fixed and moving images as well as their segmentations are available for training, while segmentations are not available during testing; a common scenario in radiotherapy. The proposed framework consists of a 3D end-to-end generator network that estimates the deformation vector field (DVF) between fixed and moving images in an unsupervised fashion and applies this DVF to the moving image and its segmentation. A discriminator network is trained to evaluate how well the moving image and segmentation align with the fixed image and segmentation. The proposed network was trained and evaluated on follow-up prostate CT scans for image-guided radiotherapy, where the planning CT contours are propagated to the daily CT images using the estimated DVF. A quantitative comparison with conventional registration using elastix showed that the proposed method improved performance and substantially reduced computation time, thus enabling real-time contour propagation necessary for online-adaptive radiotherapy.


page 5

page 7

page 8


JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scans

Multi-modal image registration is a challenging problem yet important cl...

DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation

Deep convolutional neural networks (CNNs) are state-of-the-art for seman...

Enhancing Medical Image Registration via Appearance Adjustment Networks

Deformable image registration is fundamental for many medical image anal...

Phase Collaborative Network for Multi-Phase Medical Imaging Segmentation

Integrating multi-phase information is an effective way of boosting visu...

Multi-Class Micro-CT Image Segmentation Using Sparse Regularized Deep Networks

It is common in anthropology and paleontology to address questions about...

Image Segmentation with Adaptive Spatial Priors from Joint Registration

Image segmentation is a crucial but challenging task that has many appli...

Please sign up or login with your details

Forgot password? Click here to reset