Residual Block-based Multi-Label Classification and Localization Network with Integral Regression for Vertebrae Labeling

01/01/2020
by   Chunli Qin, et al.
9

Accurate identification and localization of the vertebrae in CT scans is a critical and standard preprocessing step for clinical spinal diagnosis and treatment. Existing methods are mainly based on the integration of multiple neural networks, and most of them use the Gaussian heat map to locate the vertebrae's centroid. However, the process of obtaining the vertebrae's centroid coordinates using heat maps is non-differentiable, so it is impossible to train the network to label the vertebrae directly. Therefore, for end-to-end differential training of vertebra coordinates on CT scans, a robust and accurate automatic vertebral labeling algorithm is proposed in this study. Firstly, a novel residual-based multi-label classification and localization network is developed, which can capture multi-scale features, but also utilize the residual module and skip connection to fuse the multi-level features. Secondly, to solve the problem that the process of finding coordinates is non-differentiable and the spatial structure is not destructible, integral regression module is used in the localization network. It combines the advantages of heat map representation and direct regression coordinates to achieve end-to-end training, and can be compatible with any key point detection methods of medical image based on heat map. Finally, multi-label classification of vertebrae is carried out, which use bidirectional long short term memory (Bi-LSTM) to enhance the learning of long contextual information to improve the classification performance. The proposed method is evaluated on a challenging dataset and the results are significantly better than the state-of-the-art methods (mean localization error <3mm).

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 9

page 10

research
11/22/2017

Integral Human Pose Regression

State-of-the-art human pose estimation methods are dominated by complex ...
research
07/18/2017

Order-Free RNN with Visual Attention for Multi-Label Classification

In this paper, we propose the joint learning attention and recurrent neu...
research
12/09/2018

Joint Vertebrae Identification and Localization in Spinal CT Images by Combining Short- and Long-Range Contextual Information

Automatic vertebrae identification and localization from arbitrary CT im...
research
11/08/2017

Multi-label Image Recognition by Recurrently Discovering Attentional Regions

This paper proposes a novel deep architecture to address multi-label ima...
research
05/04/2023

Point Transformer For Coronary Artery Labeling

Coronary CT angiography (CCTA) scans are widely used for diagnosis of co...
research
09/05/2023

Multi-label affordance mapping from egocentric vision

Accurate affordance detection and segmentation with pixel precision is a...
research
04/08/2010

Ontology-supported processing of clinical text using medical knowledge integration for multi-label classification of diagnosis coding

This paper discusses the knowledge integration of clinical information e...

Please sign up or login with your details

Forgot password? Click here to reset