Transformers in Medical Imaging: A Survey

by   Fahad Shamshad, et al.

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of convolutional neural networks (CNNs) as de facto operators. Capitalizing on these advances in computer vision, the medical imaging field has also witnessed growing interest for Transformers that can capture global context compared to CNNs with local receptive fields. Inspired from this transition, in this survey, we attempt to provide a comprehensive review of the applications of Transformers in medical imaging covering various aspects, ranging from recently proposed architectural designs to unsolved issues. Specifically, we survey the use of Transformers in medical image segmentation, detection, classification, reconstruction, synthesis, registration, clinical report generation, and other tasks. In particular, for each of these applications, we develop taxonomy, identify application-specific challenges as well as provide insights to solve them, and highlight recent trends. Further, we provide a critical discussion of the field's current state as a whole, including the identification of key challenges, open problems, and outlining promising future directions. We hope this survey will ignite further interest in the community and provide researchers with an up-to-date reference regarding applications of Transformer models in medical imaging. Finally, to cope with the rapid development in this field, we intend to regularly update the relevant latest papers and their open-source implementations at <>.



There are no comments yet.


page 3

page 11

page 18

page 19

page 21

page 24

page 28

page 30


Vision Transformers in Medical Computer Vision – A Contemplative Retrospection

Recent escalation in the field of computer vision underpins a huddle of ...

Is it Time to Replace CNNs with Transformers for Medical Images?

Convolutional Neural Networks (CNNs) have reigned for a decade as the de...

How I failed machine learning in medical imaging – shortcomings and recommendations

Medical imaging is an important research field with many opportunities f...

Going Deep in Medical Image Analysis: Concepts, Methods, Challenges and Future Directions

Medical Image Analysis is currently experiencing a paradigm shift due to...

A Survey of Transformers

Transformers have achieved great success in many artificial intelligence...

Recent Advances in Vision Transformer: A Survey and Outlook of Recent Work

Vision Transformers (ViTs) are becoming more popular and dominating tech...

A Survey of Crowdsourcing in Medical Image Analysis

Rapid advances in image processing capabilities have been seen across ma...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.