Towards Robotic Eye Surgery: Marker-free, Online Hand-eye Calibration using Optical Coherence Tomography Images

08/17/2018
by   Mingchuan Zhou, et al.
0

Ophthalmic microsurgery is known to be a challenging operation, which requires very precise and dexterous manipulation. Image guided robot-assisted surgery (RAS) is a promising solution that brings significant improvements in outcomes and reduces the physical limitations of human surgeons. However, this technology must be further developed before it can be routinely used in clinics. One of the problems is the lack of proper calibration between the robotic manipulator and appropriate imaging device. In this work, we developed a flexible framework for hand-eye calibration of an ophthalmic robot with a microscope-integrated Optical Coherence Tomography (MIOCT) without any markers. The proposed method consists of three main steps: a) we estimate the OCT calibration parameters; b) with micro-scale displacements controlled by the robot, we detect and segment the needle tip in 3D-OCT volume; c) we find the transformation between the coordinate system of the OCT camera and the coordinate system of the robot. We verified the capability of our framework in ex-vivo pig eye experiments and compared the results with a reference method (marker-based). In all experiments, our method showed a small difference from the marker based method, with a mean calibration error of 9.2 μm and 7.0 μm, respectively. Additionally, the noise test shows the robustness of the proposed method.

READ FULL TEXT
research
06/04/2023

Online estimation of the hand-eye transformation from surgical scenes

Hand-eye calibration algorithms are mature and provide accurate transfor...
research
04/17/2023

Applications of Uncalibrated Image Based Visual Servoing in Micro- and Macroscale Robotics

We present a robust markerless image based visual servoing method that e...
research
02/03/2020

Toward Autonomous Robotic Micro-Suturing using Optical Coherence Tomography Calibration and Path Planning

Robotic automation has the potential to assist human surgeons in perform...
research
09/06/2023

Steady-Hand Eye Robot 3.0: Optimization and Benchtop Evaluation for Subretinal Injection

Subretinal injection methods and other procedures for treating retinal c...
research
05/12/2022

Economical Precise Manipulation and Auto Eye-Hand Coordination with Binocular Visual Reinforcement Learning

Precision robotic manipulation tasks (insertion, screwing, precisely pic...
research
12/11/2020

Spotlight-based 3D Instrument Guidance for Retinal Surgery

Retinal surgery is a complex activity that can be challenging for a surg...
research
04/10/2009

Fuzzy inference based mentality estimation for eye robot agent

Household robots need to communicate with human beings in a friendly fas...

Please sign up or login with your details

Forgot password? Click here to reset