A Learning Strategy for Contrast-agnostic MRI Segmentation

03/04/2020
by   Benjamin Billot, et al.
8

We present a deep learning strategy that enables, for the first time, contrast-agnostic semantic segmentation of completely unpreprocessed brain MRI scans, without requiring additional training or fine-tuning for new modalities. Classical Bayesian methods address this segmentation problem with unsupervised intensity models, but require significant computational resources. In contrast, learning-based methods can be fast at test time, but are sensitive to the data available at training. Our proposed learning method, SynthSeg, leverages a set of training segmentations (no intensity images required) to generate synthetic sample images of widely varying contrasts on the fly during training. These samples are produced using the generative model of the classical Bayesian segmentation framework, with randomly sampled parameters for appearance, deformation, noise, and bias field. Because each mini-batch has a different synthetic contrast, the final network is not biased towards any MRI contrast. We comprehensively evaluate our approach on four datasets comprising over 1,000 subjects and four types of MR contrast. The results show that our approach successfully segments every contrast in the data, performing slightly better than classical Bayesian segmentation, and three orders of magnitude faster. Moreover, even within the same type of MRI contrast, our strategy generalizes significantly better across datasets, compared to training using real images. Finally, we find that synthesizing a broad range of contrasts, even if unrealistic, increases the generalization of the neural network. Our code and model are open source at https://github.com/BBillot/SynthSeg.

READ FULL TEXT

page 6

page 9

page 11

research
07/20/2021

SynthSeg: Domain Randomisation for Segmentation of Brain MRI Scans of any Contrast and Resolution

Despite advances in data augmentation and transfer learning, convolution...
research
04/25/2019

Unsupervised deep learning for Bayesian brain MRI segmentation

Probabilistic atlas priors have been commonly used to derive adaptive an...
research
07/06/2022

Multi-Contrast MRI Segmentation Trained on Synthetic Images

In our comprehensive experiments and evaluations, we show that it is pos...
research
06/22/2023

Can a single image processing algorithm work equally well across all phases of DCE-MRI?

Image segmentation and registration are said to be challenging when appl...
research
04/21/2020

Partial Volume Segmentation of Brain MRI Scans of any Resolution and Contrast

Partial voluming (PV) is arguably the last crucial unsolved problem in B...
research
02/04/2023

Model Stitching and Visualization How GAN Generators can Invert Networks in Real-Time

Critical applications, such as in the medical field, require the rapid p...

Please sign up or login with your details

Forgot password? Click here to reset