Multicenter Assessment of Augmented Reality Registration Methods for Image-guided Interventions

12/03/2020
by   Ningcheng Li, et al.
0

Purpose: To evaluate manual and automatic registration times as well as accuracy with augmented reality during alignment of a holographic 3-dimensional (3D) model onto the real-world environment. Method: 18 participants in various stages of clinical training across two academic centers registered a 3D CT phantom model onto a CT grid using the HoloLens 2 augmented reality headset 3 consecutive times. Registration times and accuracy were compared among different registration methods (hand gesture, Xbox controller, and automatic registration), levels of clinical experience, and consecutive attempts. Registration times were also compared with prior HoloLens 1 data. Results: Mean aggregate manual registration times were 27.7, 24.3, and 72.8 seconds for one-handed gesture, two-handed gesture, and Xbox controller, respectively; mean automatic registration time was 5.3s (ANOVA p<0.0001). No significant difference in registration times was found among attendings, residents and fellows, and medical students (p>0.05). Significant improvements in registration times were detected across consecutive attempts using hand gestures (p<0.01). Compared with previously reported HoloLens 1 experience, hand gesture registration times were 81.7 accuracies were not significantly different across manual registration methods, measuring at 5.9, 9.5, and 8.6 mm with one-handed gesture, two-handed gesture, and Xbox controller, respectively (p>0.05). Conclusions: Manual registration times decreased significantly with updated hand gesture maneuvers on HoloLens 2 versus HoloLens 1, approaching the registration times of automatic registration and outperforming Xbox controller mediated registration. These results will encourage wider clinical integration of HoloLens 2 in procedural medical care.

READ FULL TEXT

page 13

page 16

research
07/25/2022

Eliciting Multimodal Gesture+Speech Interactions in a Multi-Object Augmented Reality Environment

As augmented reality technology and hardware become more mature and affo...
research
08/05/2023

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Established surgical navigation systems for pedicle screw placement have...
research
02/22/2022

Comparing Controller With the Hand Gestures Pinch and Grab for Picking Up and Placing Virtual Objects

Grabbing virtual objects is one of the essential tasks for Augmented, Vi...
research
09/14/2020

Understanding Gesture and Speech Multimodal Interactions for Manipulation Tasks in Augmented Reality Using Unconstrained Elicitation

This research establishes a better understanding of the syntax choices i...
research
08/08/2019

Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality

Augmented reality has the potential to improve operating room workflow b...
research
03/07/2023

Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices

Older adults increasingly adopt small-screen devices, but limited motor ...
research
09/16/2022

KaliCalib: A Framework for Basketball Court Registration

Tracking the players and the ball in team sports is key to analyse the p...

Please sign up or login with your details

Forgot password? Click here to reset