DeepAI AI Chat
Log In Sign Up

Deep Learning-Based Regression and Classification for Automatic Landmark Localization in Medical Images

by   Julia M. H. Noothout, et al.

In this study, we propose a fast and accurate method to automatically localize anatomical landmarks in medical images. We employ a global-to-local localization approach using fully convolutional neural networks (FCNNs). First, a global FCNN localizes multiple landmarks through the analysis of image patches, performing regression and classification simultaneously. In regression, displacement vectors pointing from the center of image patches towards landmark locations are determined. In classification, presence of landmarks of interest in the patch is established. Global landmark locations are obtained by averaging the predicted displacement vectors, where the contribution of each displacement vector is weighted by the posterior classification probability of the patch that it is pointing from. Subsequently, for each landmark localized with global localization, local analysis is performed. Specialized FCNNs refine the global landmark locations by analyzing local sub-images in a similar manner, i.e. by performing regression and classification simultaneously and combining the results. Evaluation was performed through localization of 8 anatomical landmarks in CCTA scans, 2 landmarks in olfactory MR scans, and 19 landmarks in cephalometric X-rays. We demonstrate that the method performs similarly to a second observer and is able to localize landmarks in a diverse set of medical images, differing in image modality, image dimensionality, and anatomical coverage.


page 1

page 2

page 3

page 4

page 6

page 7

page 9


CNN-based Landmark Detection in Cardiac CTA Scans

Fast and accurate anatomical landmark detection can benefit many medical...

Discovering Salient Anatomical Landmarks by Predicting Human Gaze

Anatomical landmarks are a crucial prerequisite for many medical imaging...

KNEEL: Knee Anatomical Landmark Localization Using Hourglass Networks

This paper addresses the challenge of localization of anatomical landmar...

One-Shot Object Localization in Medical Images based on Relative Position Regression

Deep learning networks have shown promising performance for accurate obj...

Multi-dimensional Gated Recurrent Units for Automated Anatomical Landmark Localization

We present an automated method for localizing an anatomical landmark in ...

Spine Landmark Localization with combining of Heatmap Regression and Direct Coordinate Regression

Landmark Localization plays a very important role in processing medical ...

Anatomical Landmarks Localization for 3D Foot Point Clouds

3D anatomical landmarks play an important role in health research. Their...