Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing

01/17/2023
by   Shervin Dehghani, et al.
0

In the last decade, various robotic platforms have been introduced that could support delicate retinal surgeries. Concurrently, to provide semantic understanding of the surgical area, recent advances have enabled microscope-integrated intraoperative Optical Coherent Tomography (iOCT) with high-resolution 3D imaging at near video rate. The combination of robotics and semantic understanding enables task autonomy in robotic retinal surgery, such as for subretinal injection. This procedure requires precise needle insertion for best treatment outcomes. However, merging robotic systems with iOCT introduces new challenges. These include, but are not limited to high demands on data processing rates and dynamic registration of these systems during the procedure. In this work, we propose a framework for autonomous robotic navigation for subretinal injection, based on intelligent real-time processing of iOCT volumes. Our method consists of an instrument pose estimation method, an online registration between the robotic and the iOCT system, and trajectory planning tailored for navigation to an injection target. We also introduce intelligent virtual B-scans, a volume slicing approach for rapid instrument pose estimation, which is enabled by Convolutional Neural Networks (CNNs). Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method. Finally, we discuss identified challenges in this work and suggest potential solutions to further the development of such systems.

READ FULL TEXT

page 1

page 2

page 4

research
11/30/2021

ColibriDoc: An Eye-in-Hand Autonomous Trocar Docking System

Retinal surgery is a complex medical procedure that requires exceptional...
research
06/16/2023

Deep Learning Guided Autonomous Retinal Surgery using a Robotic Arm, Microscopy, and iOCT Imaging

Recent technological advancements in retinal surgery has led to the mode...
research
03/05/2017

SegICP: Integrated Deep Semantic Segmentation and Pose Estimation

Recent robotic manipulation competitions have highlighted that sophistic...
research
07/08/2020

Searching for Efficient Architecture for Instrument Segmentation in Robotic Surgery

Segmentation of surgical instruments is an important problem in robot-as...
research
05/25/2022

Development of a Stereo-Vision Based High-Throughput Robotic System for Mouse Tail Vein Injection

In this paper, we present a robotic device for mouse tail vein injection...
research
03/15/2021

MBAPose: Mask and Bounding-Box Aware Pose Estimation of Surgical Instruments with Photorealistic Domain Randomization

Surgical robots are controlled using a priori models based on robots' ge...
research
03/12/2021

Patient-specific virtual spine straightening and vertebra inpainting: An automatic framework for osteoplasty planning

Symptomatic spinal vertebral compression fractures (VCFs) often require ...

Please sign up or login with your details

Forgot password? Click here to reset