A New Probabilistic V-Net Model with Hierarchical Spatial Feature Transform for Efficient Abdominal Multi-Organ Segmentation

08/02/2022
by   Minfeng Xu, et al.
0

Accurate and robust abdominal multi-organ segmentation from CT imaging of different modalities is a challenging task due to complex inter- and intra-organ shape and appearance variations among abdominal organs. In this paper, we propose a probabilistic multi-organ segmentation network with hierarchical spatial-wise feature modulation to capture flexible organ semantic variants and inject the learnt variants into different scales of feature maps for guiding segmentation. More specifically, we design an input decomposition module via a conditional variational auto-encoder to learn organ-specific distributions on the low dimensional latent space and model richer organ semantic variations that is conditioned on input images.Then by integrating these learned variations into the V-Net decoder hierarchically via spatial feature transformation, which has the ability to convert the variations into conditional Affine transformation parameters for spatial-wise feature maps modulating and guiding the fine-scale segmentation. The proposed method is trained on the publicly available AbdomenCT-1K dataset and evaluated on two other open datasets, i.e., 100 challenging/pathological testing patient cases from AbdomenCT-1K fully-supervised abdominal organ segmentation benchmark and 90 cases from TCIA+ BTCV dataset. Highly competitive or superior quantitative segmentation results have been achieved using these datasets for four abdominal organs of liver, kidney, spleen and pancreas with reported Dice scores improved by 7.3 strong baseline segmentation methods(nnUNet and CoTr).

READ FULL TEXT

page 6

page 7

page 11

page 12

research
05/30/2019

A Hierarchical Probabilistic U-Net for Modeling Multi-Scale Ambiguities

Medical imaging only indirectly measures the molecular identity of the t...
research
08/29/2022

Boundary-Aware Network for Abdominal Multi-Organ Segmentation

Automated abdominal multi-organ segmentation is a crucial yet challengin...
research
08/21/2020

INSIDE: Steering Spatial Attention with Non-Imaging Information in CNNs

We consider the problem of integrating non-imaging information into segm...
research
05/18/2017

Spatial Variational Auto-Encoding via Matrix-Variate Normal Distributions

The key idea of variational auto-encoders (VAEs) resembles that of tradi...
research
06/04/2020

Uncertainty quantification in medical image segmentation with Normalizing Flows

Medical image segmentation is inherently an ambiguous task due to factor...
research
06/25/2019

MFP-Unet: A Novel Deep Learning Based Approach for Left Ventricle Segmentation in Echocardiography

Segmentation of the Left ventricle (LV) is a crucial step for quantitati...
research
07/25/2019

Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentation

We propose a new deep learning method for tumour segmentation when deali...

Please sign up or login with your details

Forgot password? Click here to reset