A surgical system for automatic registration, stiffness mapping and dynamic image overlay

11/23/2017
by   Nicolas Zevallos, et al.
0

In this paper we develop a surgical system using the da Vinci research kit (dVRK) that is capable of autonomously searching for tumors and dynamically displaying the tumor location using augmented reality. Such a system has the potential to quickly reveal the location and shape of tumors and visually overlay that information to reduce the cognitive overload of the surgeon. We believe that our approach is one of the first to incorporate state-of-the-art methods in registration, force sensing and tumor localization into a unified surgical system. First, the preoperative model is registered to the intra-operative scene using a Bingham distribution-based filtering approach. An active level set estimation is then used to find the location and the shape of the tumors. We use a recently developed miniature force sensor to perform the palpation. The estimated stiffness map is then dynamically overlaid onto the registered preoperative model of the organ. We demonstrate the efficacy of our system by performing experiments on phantom prostate models with embedded stiff inclusions.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
05/13/2021

Surgical navigation systems based on augmented reality technologies

This study considers modern surgical navigation systems based on augment...
research
08/05/2023

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Established surgical navigation systems for pedicle screw placement have...
research
01/17/2020

Registration made easy – standalone orthopedic navigation with HoloLens

In surgical navigation, finding correspondence between preoperative plan...
research
10/12/2021

Planning Sensing Sequences for Subsurface 3D Tumor Mapping

Surgical automation has the potential to enable increased precision and ...
research
08/29/2016

ORBSLAM-based Endoscope Tracking and 3D Reconstruction

We aim to track the endoscope location inside the surgical scene and pro...
research
07/31/2018

Learning to See Forces: Surgical Force Prediction with RGB-Point Cloud Temporal Convolutional Networks

Robotic surgery has been proven to offer clear advantages during surgica...
research
09/18/2023

Efficient and Accurate Mapping of Subsurface Anatomy via Online Trajectory Optimization for Robot Assisted Surgery

Robotic surgical subtask automation has the potential to reduce the per-...

Please sign up or login with your details

Forgot password? Click here to reset