GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathology Image Classification

04/29/2021
by   Haoyuan Chen, et al.
5

For deep learning methods applied to the diagnosis of gastric cancer intelligently, existing methods concentrate more on Convolutional Neural Networks (CNN) but no approaches are available using Visual Transformer (VT). VT's efficient and stable deep learning models with the most recent application in the field of computer vision, which is capable of improving the recognition of global information in images. In this paper, a multi-scale visual transformer model (GasHis-Transformer) is proposed for a gastric histopathology image classification (GHIC) task, which enables the automatic classification of gastric histological images of abnormal and normal cancer by obtained by optical microscopy to facilitate the medical work of histopathologists. This GasHis-Transformer model is built on two fundamental modules, including a global information module (GIM) and a local information module (LIM). In the experiment, an open source hematoxylin and eosin (H E) stained gastric histopathology dataset with 280 abnormal or normal images are divided into training, validation, and test sets at a ratio of 1:1:2 first. Then, GasHis-Transformer obtains precision, recall, F1-score, and accuracy on the testing set of 98.0 experiment also tests the generalization ability of the proposed GatHis-Transformer model with a lymphoma image dataset including 374 images and a breast cancer dataset including 1390 images in two extended experiments and achieves an accuracy of 83.9 GasHis-Transformer model demonstrates high classification performance and shows its effectiveness and enormous potential in GHIC tasks.

READ FULL TEXT

page 2

page 6

page 8

page 9

page 11

page 12

page 13

page 15

research
06/02/2022

CVM-Cervix: A Hybrid Cervical Pap-Smear Image Classification Framework Using CNN, Visual Transformer and Multilayer Perceptron

Cervical cancer is the seventh most common cancer among all the cancers ...
research
03/11/2018

Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification

This paper explores the problem of breast tissue classification of micro...
research
12/27/2021

MSHT: Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer

Pancreatic cancer is one of the most malignant cancers in the world, whi...
research
11/04/2021

PDBL: Improving Histopathological Tissue Classification with Plug-and-Play Pyramidal Deep-Broad Learning

Histopathological tissue classification is a fundamental task in pathomi...
research
04/18/2023

Multi-Modality Multi-Scale Cardiovascular Disease Subtypes Classification Using Raman Image and Medical History

Raman spectroscopy (RS) has been widely used for disease diagnosis, e.g....
research
07/03/2020

Selecting Regions of Interest in Large Multi-Scale Images for Cancer Pathology

Recent breakthroughs in object detection and image classification using ...
research
05/30/2020

SDCT-AuxNet^θ: DCT Augmented Stain Deconvolutional CNN with Auxiliary Classifier for Cancer Diagnosis

Acute lymphoblastic leukemia (ALL) is a pervasive pediatric white blood ...

Please sign up or login with your details

Forgot password? Click here to reset