Pelphix: Surgical Phase Recognition from X-ray Images in Percutaneous Pelvic Fixation

04/18/2023
by   Benjamin D. Killeen, et al.
16

Surgical phase recognition (SPR) is a crucial element in the digital transformation of the modern operating theater. While SPR based on video sources is well-established, incorporation of interventional X-ray sequences has not yet been explored. This paper presents Pelphix, a first approach to SPR for X-ray-guided percutaneous pelvic fracture fixation, which models the procedure at four levels of granularity – corridor, activity, view, and frame value – simulating the pelvic fracture fixation workflow as a Markov process to provide fully annotated training data. Using added supervision from detection of bony corridors, tools, and anatomy, we learn image representations that are fed into a transformer model to regress surgical phases at the four granularity levels. Our approach demonstrates the feasibility of X-ray-based SPR, achieving an average accuracy of 93.8 in cadaver across all granularity levels, with up to 88 target corridor in real data. This work constitutes the first step toward SPR for the X-ray domain, establishing an approach to categorizing phases in X-ray-guided surgery, simulating realistic image sequences to enable machine learning model development, and demonstrating that this approach is feasible for the analysis of real procedures. As X-ray-based SPR continues to mature, it will benefit procedures in orthopedic surgery, angiography, and interventional radiology by equipping intelligent surgical systems with situational awareness in the operating room.

READ FULL TEXT

page 2

page 4

research
03/24/2021

MIcro-Surgical Anastomose Workflow recognition challenge report

The "MIcro-Surgical Anastomose Workflow recognition on training sessions...
research
02/24/2021

Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures

Purpose: Automatic segmentation and classification of surgical activity ...
research
02/11/2022

PEg TRAnsfer Workflow recognition challenge report: Does multi-modal data improve recognition?

This paper presents the design and results of the "PEg TRAnsfert Workflo...
research
06/06/2018

Real-time Surgical Tools Recognition in Total Knee Arthroplasty Using Deep Neural Networks

Total knee arthroplasty (TKA) is a commonly performed surgical procedure...
research
09/12/2022

Situation Awareness for Automated Surgical Check-listing in AI-Assisted Operating Room

Nowadays, there are more surgical procedures that are being performed us...
research
06/13/2022

SyntheX: Scaling Up Learning-based X-ray Image Analysis Through In Silico Experiments

Artificial intelligence (AI) now enables automated interpretation of med...
research
05/21/2019

Contrast Enhancement of Medical X-Ray Image Using Morphological Operators with Optimal Structuring Element

To guide surgical and medical treatment X-ray images have been used by p...

Please sign up or login with your details

Forgot password? Click here to reset