Simulating Realistic MRI variations to Improve Deep Learning model and visual explanations using GradCAM

by   Muhammad Ilyas Patel, et al.

In the medical field, landmark detection in MRI plays an important role in reducing medical technician efforts in tasks like scan planning, image registration, etc. First, 88 landmarks spread across the brain anatomy in the three respective views – sagittal, coronal, and axial are manually annotated, later guidelines from the expert clinical technicians are taken sub-anatomy-wise, for better localization of the existing landmarks, in order to identify and locate the important atlas landmarks even in oblique scans. To overcome limited data availability, we implement realistic data augmentation to generate synthetic 3D volumetric data. We use a modified HighRes3DNet model for solving brain MRI volumetric landmark detection problem. In order to visually explain our trained model on unseen data, and discern a stronger model from a weaker model, we implement Gradient-weighted Class Activation Mapping (Grad-CAM) which produces a coarse localization map highlighting the regions the model is focusing. Our experiments show that the proposed method shows favorable results, and the overall pipeline can be extended to a variable number of landmarks and other anatomies.


page 1

page 4

page 5

page 6

page 8


Towards multi-modal anatomical landmark detection for ultrasound-guided brain tumor resection with contrastive learning

Homologous anatomical landmarks between medical scans are instrumental i...

Discovering Salient Anatomical Landmarks by Predicting Human Gaze

Anatomical landmarks are a crucial prerequisite for many medical imaging...

Automatic 3D Registration of Dental CBCT and Face Scan Data using 2D Projection images

This paper presents a fully automatic registration method of dental cone...

Improving prostate whole gland segmentation in t2-weighted MRI with synthetically generated data

Whole gland (WG) segmentation of the prostate plays a crucial role in de...

Joint Voxel and Coordinate Regression for Accurate 3D Facial Landmark Localization

3D face shape is more expressive and viewpoint-consistent than its 2D co...

Spine Landmark Localization with combining of Heatmap Regression and Direct Coordinate Regression

Landmark Localization plays a very important role in processing medical ...

Reciprocal Landmark Detection and Tracking with Extremely Few Annotations

Localization of anatomical landmarks to perform two-dimensional measurem...

Please sign up or login with your details

Forgot password? Click here to reset