DeepAI AI Chat
Log In Sign Up

DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation

by   Zhenlin Xu, et al.

Deep convolutional neural networks (CNNs) are state-of-the-art for semantic image segmentation, but typically require many labeled training samples. Obtaining 3D segmentations of medical images for supervised training is difficult and labor intensive. Motivated by classical approaches for joint segmentation and registration we therefore propose a deep learning framework that jointly learns networks for image registration and image segmentation. In contrast to previous work on deep unsupervised image registration, which showed the benefit of weak supervision via image segmentations, our approach can use existing segmentations when available and computes them via the segmentation network otherwise, thereby providing the same registration benefit. Conversely, segmentation network training benefits from the registration, which essentially provides a realistic form of data augmentation. Experiments on knee and brain 3D magnetic resonance (MR) images show that our approach achieves large simultaneous improvements of segmentation and registration accuracy (over independently trained networks) and allows training high-quality models with very limited training data. Specifically, in a one-shot-scenario (with only one manually labeled image) our approach increases Dice scores ( unsupervised registration network by 2.7 and 1.8 on the knee and brain images respectively.


page 6

page 9


Few Labeled Atlases are Necessary for Deep-Learning-Based Segmentation

We tackle biomedical image segmentation in the scenario of only a few la...

Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networks

Deep learning models for semantic segmentation are able to learn powerfu...

Learning Multi-Modal Volumetric Prostate Registration with Weak Inter-Subject Spatial Correspondence

Recent studies demonstrated the eligibility of convolutional neural netw...

Few-shot brain segmentation from weakly labeled data with deep heteroscedastic multi-task networks

In applications of supervised learning applied to medical image segmenta...

Adversarial optimization for joint registration and segmentation in prostate CT radiotherapy

Joint image registration and segmentation has long been an active area o...