Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality

08/08/2019
by   Andong Cao, et al.
0

Augmented reality has the potential to improve operating room workflow by allowing physicians to "see" inside a patient through the projection of imaging directly onto the surgical field. For this to be useful the acquired imaging must be quickly and accurately registered with patient and the registration must be maintained. Here we describe a method for projecting a CT scan with Microsoft Hololens and then aligning that projection to a set of fiduciary markers. Radio-opaque stickers with unique QR-codes are placed on an object prior to acquiring a CT scan. The location of the markers in the CT scan are extracted and the CT scan is converted into a 3D surface object. The 3D object is then projected using the Hololens onto a table on which the same markers are placed. We designed an algorithm that aligns the markers on the 3D object with the markers on the table. To extract the markers and convert the CT into a 3D object took less than 5 seconds. To align three markers, it took 0.9 ± 0.2 seconds to achieve an accuracy of 5 ± 2 mm. These findings show that it is feasible to use a combined radio-opaque optical marker, placed on a patient prior to a CT scan, to subsequently align the acquired CT scan with the patient.

READ FULL TEXT
research
09/04/2019

3D landmark detection for augmented reality based otologic procedures

Ear consists of the smallest bones in the human body and does not contai...
research
05/13/2021

Surgical navigation systems based on augmented reality technologies

This study considers modern surgical navigation systems based on augment...
research
03/22/2018

Closing the Calibration Loop: An Inside-out-tracking Paradigm for Augmented Reality in Orthopedic Surgery

In percutaneous orthopedic interventions the surgeon attempts to reduce ...
research
12/03/2020

Multicenter Assessment of Augmented Reality Registration Methods for Image-guided Interventions

Purpose: To evaluate manual and automatic registration times as well as ...
research
05/03/2021

A rigged model of the breast for preoperative surgical planning

In breast surgical practice, various scans and medical examinations are ...
research
01/15/2015

Computer-assisted polyp matching between optical colonoscopy and CT colonography: a phantom study

Potentially precancerous polyps detected with CT colonography (CTC) need...
research
05/10/2020

Intracranial Hemorrhage Detection Using Neural Network Based Methods With Federated Learning

Intracranial hemorrhage, bleeding that occurs inside the cranium, is a s...

Please sign up or login with your details

Forgot password? Click here to reset