Needle Tip Force Estimation using an OCT Fiber and a Fused convGRU-CNN Architecture

05/30/2018
by   Nils Gessert, et al.
0

Needle insertion is common during minimally invasive interventions such as biopsy or brachytherapy. During soft tissue needle insertion, forces acting at the needle tip cause tissue deformation and needle deflection. Accurate needle tip force measurement provides information on needle-tissue interaction and helps detecting and compensating potential misplacement. For this purpose we introduce an image-based needle tip force estimation method using an optical fiber imaging the deformation of an epoxy layer below the needle tip over time. For calibration and force estimation, we introduce a novel deep learning-based fused convolutional GRU-CNN model which effectively exploits the spatio-temporal data structure. The needle is easy to manufacture and our model achieves a mean absolute error of 1.76 +- 1.5 mN with a cross-correlation coefficient of 0.9996, clearly outperforming other methods. We test needles with different materials to demonstrate that the approach can be adapted for different sensitivities and force ranges. Furthermore, we validate our approach in an ex-vivo prostate needle insertion scenario.

READ FULL TEXT
research
05/22/2019

Spatio-Temporal Deep Learning Models for Tip Force Estimation During Needle Insertion

Purpose. Precise placement of needles is a challenge in a number of clin...
research
04/26/2018

Force Estimation from OCT Volumes using 3D CNNs

Purpose Estimating the interaction forces of instruments and tissue is o...
research
11/17/2018

Sequential Image-based Attention Network for Inferring Force Estimation without Haptic Sensor

Humans can infer approximate interaction force between objects from only...
research
07/24/2019

Real-time Deformation of Soft Tissue Internal Structure with Surface Profile Variations using Particle System

Intraoperative observation of tissue internal structure is often difficu...
research
08/23/2019

Image based cellular contractile force evaluation with small-world network inspired CNN: SW-UNet

We propose an image-based cellular contractile force evaluation method u...
research
07/31/2018

Learning to See Forces: Surgical Force Prediction with RGB-Point Cloud Temporal Convolutional Networks

Robotic surgery has been proven to offer clear advantages during surgica...
research
08/07/2023

DefCor-Net: Physics-Aware Ultrasound Deformation Correction

The recovery of morphologically accurate anatomical images from deformed...

Please sign up or login with your details

Forgot password? Click here to reset