Virtual Reality for Synergistic Surgical Training and Data Generation

11/15/2021
by   Adnan Munawar, et al.
0

Surgical simulators not only allow planning and training of complex procedures, but also offer the ability to generate structured data for algorithm development, which may be applied in image-guided computer assisted interventions. While there have been efforts on either developing training platforms for surgeons or data generation engines, these two features, to our knowledge, have not been offered together. We present our developments of a cost-effective and synergistic framework, named Asynchronous Multibody Framework Plus (AMBF+), which generates data for downstream algorithm development simultaneously with users practicing their surgical skills. AMBF+ offers stereoscopic display on a virtual reality (VR) device and haptic feedback for immersive surgical simulation. It can also generate diverse data such as object poses and segmentation maps. AMBF+ is designed with a flexible plugin setup which allows for unobtrusive extension for simulation of different surgical procedures. We show one use case of AMBF+ as a virtual drilling simulator for lateral skull-base surgery, where users can actively modify the patient anatomy using a virtual surgical drill. We further demonstrate how the data generated can be used for validating and training downstream computer vision algorithms

READ FULL TEXT

page 3

page 4

page 7

page 9

page 11

research
02/27/2023

Fully Immersive Virtual Reality for Skull-base Surgery: Surgical Training and Beyond

Purpose: A fully immersive virtual reality system (FIVRS), where surgeon...
research
07/30/2022

Virtual Reality Simulator for Fetoscopic Spina Bifida Repair Surgery

Spina Bifida (SB) is a birth defect developed during the early stage of ...
research
03/03/2023

Improving Surgical Situational Awareness with Signed Distance Field: A Pilot Study in Virtual Reality

The introduction of image-guided surgical navigation (IGSN) has greatly ...
research
03/08/2019

A Survey of Visuo-Haptic Simulation in Surgical Training

Surgeons must accomplish complex technical and intellectual tasks that c...
research
10/08/2021

Generational Frameshifts in Technology: Computer Science and Neurosurgery, The VR Use Case

We are at a unique moment in history where there is a confluence of tech...
research
11/05/2020

Immersive Anatomical Scenes that Enable Multiple Users to Occupy the Same Virtual Space: A Tool for Surgical Planning and Education

3D modeling is becoming a well-developed field of medicine, but its appl...
research
03/11/2023

A Virtual-Based Haptic Endoscopic Sinus Surgery (ESS) Training System: from Development to Validation

Simulated training platforms offer a suitable avenue for surgical studen...

Please sign up or login with your details

Forgot password? Click here to reset