MNet: Rethinking 2D/3D Networks for Anisotropic Medical Image Segmentation

05/10/2022
by   Zhangfu Dong, et al.
0

The nature of thick-slice scanning causes severe inter-slice discontinuities of 3D medical images, and the vanilla 2D/3D convolutional neural networks (CNNs) fail to represent sparse inter-slice information and dense intra-slice information in a balanced way, leading to severe underfitting to inter-slice features (for vanilla 2D CNNs) and overfitting to noise from long-range slices (for vanilla 3D CNNs). In this work, a novel mesh network (MNet) is proposed to balance the spatial representation inter axes via learning. 1) Our MNet latently fuses plenty of representation processes by embedding multi-dimensional convolutions deeply into basic modules, making the selections of representation processes flexible, thus balancing representation for sparse inter-slice information and dense intra-slice information adaptively. 2) Our MNet latently fuses multi-dimensional features inside each basic module, simultaneously taking the advantages of 2D (high segmentation accuracy of the easily recognized regions in 2D view) and 3D (high smoothness of 3D organ contour) representations, thus obtaining more accurate modeling for target regions. Comprehensive experiments are performed on four public datasets (CT&MR), the results consistently demonstrate the proposed MNet outperforms the other methods. The code and datasets are available at: https://github.com/zfdong-code/MNet

READ FULL TEXT

page 4

page 6

research
11/28/2020

Inter-slice Context Residual Learning for 3D Medical Image Segmentation

Automated and accurate 3D medical image segmentation plays an essential ...
research
03/23/2022

Semi-Supervised Hybrid Spine Network for Segmentation of Spine MR Images

Automatic segmentation of vertebral bodies (VBs) and intervertebral disc...
research
03/21/2022

Slice Imputation: Intermediate Slice Interpolation for Anisotropic 3D Medical Image Segmentation

We introduce a novel frame-interpolation-based method for slice imputati...
research
08/15/2021

Multi-Slice Dense-Sparse Learning for Efficient Liver and Tumor Segmentation

Accurate automatic liver and tumor segmentation plays a vital role in tr...
research
05/23/2022

Arbitrary Reduction of MRI Slice Spacing Based on Local-Aware Implicit Representation

Magnetic resonance (MR) images are often acquired in 2D settings for rea...
research
05/16/2022

An Effective Transformer-based Solution for RSNA Intracranial Hemorrhage Detection Competition

We present an effective method for Intracranial Hemorrhage Detection (IH...
research
08/03/2022

LSSANet: A Long Short Slice-Aware Network for Pulmonary Nodule Detection

Convolutional neural networks (CNNs) have been demonstrated to be highly...

Please sign up or login with your details

Forgot password? Click here to reset