SynthSeg: Domain Randomisation for Segmentation of Brain MRI Scans of any Contrast and Resolution

07/20/2021
by   Benjamin Billot, et al.
39

Despite advances in data augmentation and transfer learning, convolutional neural networks (CNNs) have difficulties generalising to unseen target domains. When applied to segmentation of brain MRI scans, CNNs are highly sensitive to changes in resolution and contrast: even within the same MR modality, decreases in performance can be observed across datasets. We introduce SynthSeg, the first segmentation CNN agnostic to brain MRI scans of any contrast and resolution. SynthSeg is trained with synthetic data sampled from a generative model inspired by Bayesian segmentation. Crucially, we adopt a domain randomisation strategy where we fully randomise the generation parameters to maximise the variability of the training data. Consequently, SynthSeg can segment preprocessed and unpreprocessed real scans of any target domain, without retraining or fine-tuning. Because SynthSeg only requires segmentations to be trained (no images), it can learn from label maps obtained automatically from existing datasets of different populations (e.g., with atrophy and lesions), thus achieving robustness to a wide range of morphological variability. We demonstrate SynthSeg on 5,500 scans of 6 modalities and 10 resolutions, where it exhibits unparalleled generalisation compared to supervised CNNs, test time adaptation, and Bayesian segmentation. The code and trained model are available at https://github.com/BBillot/SynthSeg.

READ FULL TEXT

page 1

page 5

page 10

page 11

page 12

page 13

page 18

page 20

research
04/21/2020

Partial Volume Segmentation of Brain MRI Scans of any Resolution and Contrast

Partial voluming (PV) is arguably the last crucial unsolved problem in B...
research
03/04/2020

A Learning Strategy for Contrast-agnostic MRI Segmentation

We present a deep learning strategy that enables, for the first time, co...
research
05/05/2023

Domain-agnostic segmentation of thalamic nuclei from joint structural and diffusion MRI

The human thalamus is a highly connected subcortical grey-matter structu...
research
09/05/2019

Intensity augmentation for domain transfer of whole breast segmentation in MRI

The segmentation of the breast from the chest wall is an important first...
research
08/17/2020

First U-Net Layers Contain More Domain Specific Information Than The Last Ones

MRI scans appearance significantly depends on scanning protocols and, co...
research
05/26/2023

Extremely weakly-supervised blood vessel segmentation with physiologically based synthesis and domain adaptation

Accurate analysis and modeling of renal functions require a precise segm...
research
03/03/2022

Robust Segmentation of Brain MRI in the Wild with Hierarchical CNNs and no Retraining

Retrospective analysis of brain MRI scans acquired in the clinic has the...

Please sign up or login with your details

Forgot password? Click here to reset