Mixed Transformer U-Net For Medical Image Segmentation

11/08/2021
by   Hongyi Wang, et al.
14

Though U-Net has achieved tremendous success in medical image segmentation tasks, it lacks the ability to explicitly model long-range dependencies. Therefore, Vision Transformers have emerged as alternative segmentation structures recently, for their innate ability of capturing long-range correlations through Self-Attention (SA). However, Transformers usually rely on large-scale pre-training and have high computational complexity. Furthermore, SA can only model self-affinities within a single sample, ignoring the potential correlations of the overall dataset. To address these problems, we propose a novel Transformer module named Mixed Transformer Module (MTM) for simultaneous inter- and intra- affinities learning. MTM first calculates self-affinities efficiently through our well-designed Local-Global Gaussian-Weighted Self-Attention (LGG-SA). Then, it mines inter-connections between data samples through External Attention (EA). By using MTM, we construct a U-shaped model named Mixed Transformer U-Net (MT-UNet) for accurate medical image segmentation. We test our method on two different public datasets, and the experimental results show that the proposed method achieves better performance over other state-of-the-art methods. The code is available at: https://github.com/Dootmaan/MT-UNet.

READ FULL TEXT

page 2

page 3

page 4

research
02/21/2021

Medical Transformer: Gated Axial-Attention for Medical Image Segmentation

Over the past decade, Deep Convolutional Neural Networks have been widel...
research
12/27/2022

DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentation

Transformers have recently gained attention in the computer vision domai...
research
07/16/2023

TransNuSeg: A Lightweight Multi-Task Transformer for Nuclei Segmentation

Nuclei appear small in size, yet, in real clinical practice, the global ...
research
08/07/2022

U-Net vs Transformer: Is U-Net Outdated in Medical Image Registration?

Due to their extreme long-range modeling capability, vision transformer-...
research
03/23/2023

A Permutable Hybrid Network for Volumetric Medical Image Segmentation

The advent of Vision Transformer (ViT) has brought substantial advanceme...
research
06/29/2022

The Lighter The Better: Rethinking Transformers in Medical Image Segmentation Through Adaptive Pruning

Vision transformers have recently set off a new wave in the field of med...
research
12/19/2022

Focal-UNet: UNet-like Focal Modulation for Medical Image Segmentation

Recently, many attempts have been made to construct a transformer base U...

Please sign up or login with your details

Forgot password? Click here to reset