Closing the Calibration Loop: An Inside-out-tracking Paradigm for Augmented Reality in Orthopedic Surgery

03/22/2018
by   Jonas Hajek, et al.
0

In percutaneous orthopedic interventions the surgeon attempts to reduce and fixate fractures in bony structures. The complexity of these interventions arises when the surgeon performs the challenging task of navigating surgical tools percutaneously only under the guidance of 2D interventional X-ray imaging. Moreover, the intra-operatively acquired data is only visualized indirectly on external displays. In this work, we propose a flexible Augmented Reality (AR) paradigm using optical see-through head mounted displays. The key technical contribution of this work includes the marker-less and dynamic tracking concept which closes the calibration loop between patient, C-arm and the surgeon. This calibration is enabled using Simultaneous Localization and Mapping of the environment of the operating theater. In return, the proposed solution provides in situ visualization of pre- and intra-operative 3D medical data directly at the surgical site. We demonstrate pre-clinical evaluation of a prototype system, and report errors for calibration and target registration. Finally, we demonstrate the usefulness of the proposed inside-out tracking system in achieving "bull's eye" view for C-arm-guided punctures. This AR solution provides an intuitive visualization of the anatomy and can simplify the hand-eye coordination for the orthopedic surgeon.

READ FULL TEXT

page 4

page 5

page 7

research
06/22/2018

Augmented Reality-based Feedback for Technician-in-the-loop C-arm Repositioning

Interventional C-arm imaging is crucial to percutaneous orthopedic proce...
research
01/04/2018

On-the-fly Augmented Reality for Orthopaedic Surgery Using a Multi-Modal Fiducial

Fluoroscopic X-ray guidance is a cornerstone for percutaneous orthopaedi...
research
03/04/2020

Spatiotemporal-Aware Augmented Reality: Redefining HCI in Image-Guided Therapy

Suboptimal interaction with patient data and challenges in mastering 3D ...
research
01/04/2018

Plan in 2D, execute in 3D: An augmented reality solution for cup placement in total hip arthroplasty

Reproducibly achieving proper implant alignment is a critical step in to...
research
10/02/2017

Technical Note: Towards Virtual Monitors for Image Guided Interventions - Real-time Streaming to Optical See-Through Head-Mounted Displays

Purpose: Image guidance is crucial for the success of many interventions...
research
08/08/2019

Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality

Augmented reality has the potential to improve operating room workflow b...
research
05/09/2022

A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and a 3D-printed Marker

Purpose. Ability to locate and track ultrasound images in the 3D operati...

Please sign up or login with your details

Forgot password? Click here to reset