AssemblyNet: A large ensemble of CNNs for 3D Whole Brain MRI Segmentation

by   Pierrick Coupé, et al.

Whole brain segmentation using deep learning (DL) is a very challenging task since the number of anatomical labels is very high compared to the number of available training images. To address this problem, previous DL methods proposed to use a single convolution neural network (CNN) or few independent CNNs. In this paper, we present a novel ensemble method based on a large number of CNNs processing different overlapping brain areas. Inspired by parliamentary decision-making systems, we propose a framework called AssemblyNet, made of two "assemblies" of U-Nets. Such a parliamentary system is capable of dealing with complex decisions, unseen problem and reaching a consensus quickly. AssemblyNet introduces sharing of knowledge among neighboring U-Nets, an "amendment" procedure made by the second assembly at higher-resolution to refine the decision taken by the first one, and a final decision obtained by majority voting. During our validation, AssemblyNet showed competitive performance compared to state-of-the-art methods such as U-Net, Joint label fusion and SLANT. Moreover, we investigated the scan-rescan consistency and the robustness to disease effects of our method. These experiences demonstrated the reliability of AssemblyNet. Finally, we showed the interest of using semi-supervised learning to improve the performance of our method.


page 3

page 7

page 8

page 10

page 12


AssemblyNet: A Novel Deep Decision-Making Process for Whole Brain MRI Segmentation

Whole brain segmentation using deep learning (DL) is a very challenging ...

Towards better Interpretable and Generalizable AD detection using Collective Artificial Intelligence

Accurate diagnosis and prognosis of Alzheimer's disease are crucial for ...

VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentation

Deep learning (DL) approaches are state-of-the-art for many medical imag...

Interpretable differential diagnosis for Alzheimer's disease and Frontotemporal dementia

Alzheimer's disease and Frontotemporal dementia are two major types of d...

Semi-Supervised Learning for Multi-Task Scene Understanding by Neural Graph Consensus

We address the challenging problem of semi-supervised learning in the co...

3D-OOCS: Learning Prostate Segmentation with Inductive Bias

Despite the great success of convolutional neural networks (CNN) in 3D m...

Let's agree to disagree: learning highly debatable multirater labelling

Classification and differentiation of small pathological objects may gre...