X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery

03/22/2018
by   Bastian Bier, et al.
0

X-ray image guidance enables percutaneous alternatives to complex procedures. Unfortunately, the indirect view onto the anatomy in addition to projective simplification substantially increase the task-load for the surgeon. Additional 3D information such as knowledge of anatomical landmarks can benefit surgical decision making in complicated scenarios. Automatic detection of these landmarks in transmission imaging is challenging since image-domain features characteristic to a certain landmark change substantially depending on the viewing direction. Consequently and to the best of our knowledge, the above problem has not yet been addressed. In this work, we present a method to automatically detect anatomical landmarks in X-ray images independent of the viewing direction. To this end, a sequential prediction framework based on convolutional layers is trained on synthetically generated data of the pelvic anatomy to predict 23 landmarks in single X-ray images. View independence is contingent on training conditions and, here, is achieved on a spherical segment covering (120 x 90) degrees in LAO/RAO and CRAN/CAUD, respectively, centered around AP. On synthetic data, the proposed approach achieves a mean prediction error of 5.6 +- 4.5 mm. We demonstrate that the proposed network is immediately applicable to clinically acquired data of the pelvis. In particular, we show that our intra-operative landmark detection together with pre-operative CT enables X-ray pose estimation which, ultimately, benefits initialization of image-based 2D/3D registration.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
11/14/2020

Pose-dependent weights and Domain Randomization for fully automatic X-ray to CT Registration

Fully automatic X-ray to CT registration requires a solid initialization...
research
03/22/2018

DeepDRR -- A Catalyst for Machine Learning in Fluoroscopy-guided Procedures

Machine learning-based approaches outperform competing methods in most d...
research
07/24/2019

Multi-task Localization and Segmentation for X-ray Guided Planning in Knee Surgery

X-ray based measurement and guidance are commonly used tools in orthopae...
research
06/12/2015

A Novel Hybrid Approach for Cephalometric Landmark Detection

Cephalometric analysis has an important role in dentistry and especially...
research
01/20/2019

Localizing dexterous surgical tools in X-ray for image-based navigation

X-ray image based surgical tool navigation is fast and supplies accurate...
research
01/13/2023

Multi-Target Landmark Detection with Incomplete Images via Reinforcement Learning and Shape Prior

Medical images are generally acquired with limited field-of-view (FOV), ...
research
06/10/2021

Joint Landmark and Structure Learning for Automatic Evaluation of Developmental Dysplasia of the Hip

The ultrasound (US) screening of the infant hip is vital for the early d...

Please sign up or login with your details

Forgot password? Click here to reset