Mixed reality hologram slicer (mxdR-HS): a marker-less tangible user interface for interactive holographic volume visualization

by   Hoijoon Jung, et al.

Mixed reality head-mounted displays (mxdR-HMD) have the potential to visualize volumetric medical imaging data in holograms to provide a true sense of volumetric depth. An effective user interface, however, has yet to be thoroughly studied. Tangible user interfaces (TUIs) enable a tactile interaction with a hologram through an object. The object has physical properties indicating how it might be used with multiple degrees-of-freedom. We propose a TUI using a planar object (PO) for the holographic medical volume visualization and exploration. We refer to it as mxdR hologram slicer (mxdR-HS). Users can slice the hologram to examine particular regions of interest (ROIs) and intermix complementary data and annotations. The mxdR-HS introduces a novel real-time ad-hoc marker-less PO tracking method that works with any PO where corners are visible. The aim of mxdR-HS is to maintain minimum computational latency while preserving practical tracking accuracy to enable seamless TUI integration in the commercial mxdR-HMD, which has limited computational resources. We implemented the mxdR-HS on a commercial Microsoft HoloLens with a built-in depth camera. Our experimental results showed our mxdR-HS had a superior computational latency but marginally lower tracking accuracy than two marker-based tracking methods and resulted in enhanced computational latency and tracking accuracy than 10 marker-less tracking methods. Our mxdR-HS, in a medical environment, can be suggested as a visual guide to display complex volumetric medical imaging data.



page 3

page 4

page 6

page 8

page 10

page 11


Slice-to-volume medical image registration: a survey

During the last decades, the research community of medical imaging has w...

Kalman Filter-based Head Motion Prediction for Cloud-based Mixed Reality

Volumetric video allows viewers to experience highly-realistic 3D conten...

EdgeXAR: A 6-DoF Camera Multi-target Interaction Framework for MAR with User-friendly Latency Compensation

The computational capabilities of recent mobile devices enable the proce...

Content-adaptive generation and parallel compositing of volumetric depth images for responsive visualization of large volume data

We present a content-adaptive generation and parallel compositing algori...

Low Latency Volumetric Video Edge Cloud Streaming

Volumetric video is an emerging key technology for immersive representat...

Technical Note: Towards Virtual Monitors for Image Guided Interventions - Real-time Streaming to Optical See-Through Head-Mounted Displays

Purpose: Image guidance is crucial for the success of many interventions...

Expectation Versus Reality: The Failed Evaluation of a Mixed-Initiative Visualization System

Our research aimed to present the design and evaluation of a mixed-initi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.