Augmented Reality Predictive Displays to Help Mitigate the Effects of Delayed Telesurgery

09/23/2018
by   Florian Richter, et al.
0

Surgical robots offer the exciting potential for remote telesurgery, but advances are needed to make this technology efficient and accurate to ensure patient safety. Achieving these goals is hindered by the deleterious effects of latency between the remote operator and the bedside robot. Predictive displays have found success in overcoming these effects by giving the operator immediate visual feedback. However, previously developed predictive displays can not be directly applied to telesurgery due to the unique challenges in tracking the 3D geometry of the surgical environment. In this paper, we present the first predictive display for teleoperated surgical robots. The predicted display is stereoscopic, utilizes Augmented Reality (AR) to show the predicted motions alongside the complex tissue found in-situ within surgical environments, and overcomes the challenges in accurately tracking slave-tools in real-time. We call this a Stereoscopic AR Predictive Display (SARPD). We provide measurements to show the performance of the real-time tool tracking and AR rendering. To test the SARPD's performance, we conducted a user study with ten participants on the da Vinci Surgical System. The results showed with statistical significance that using SARPD decreased time to complete task while having no effect on error rates when operating under delay.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
11/29/2018

Distributed Augmented Reality with 3D Lung Dynamics -- A Planning Tool Concept

Augmented Reality (AR) systems add visual information to the world by us...
research
10/07/2020

Using Conditional Generative Adversarial Networks to Reduce the Effects of Latency in Robotic Telesurgery

The introduction of surgical robots brought about advancements in surgic...
research
01/10/2023

The Evolution of Real-time Remote Intraoperative Neurophysiological Monitoring (IONM)

Real-time monitoring of nervous system function with immediate communica...
research
08/17/2022

STTAR: Surgical Tool Tracking using off-the-shelf Augmented Reality Head-Mounted Displays

The use of Augmented Reality (AR) for navigation purposes has shown bene...
research
04/09/2022

Robotic Surgery Remote Mentoring via AR with 3D Scene Streaming and Hand Interaction

With the growing popularity of robotic surgery, education becomes increa...
research
02/08/2019

Motion Scaling Solutions for Improved Performance in High Delay Surgical Teleoperation

Robotic teleoperation brings great potential for advances within the fie...
research
04/25/2023

Analysis and Mitigation of Shared Resource Contention on Heterogeneous Multicore: An Industrial Case Study

In this paper, we present a solution to the industrial challenge put for...

Please sign up or login with your details

Forgot password? Click here to reset