LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos

07/02/2021
by   Negin Ghamsarian, et al.
0

A critical complication after cataract surgery is the dislocation of the lens implant leading to vision deterioration and eye trauma. In order to reduce the risk of this complication, it is vital to discover the risk factors during the surgery. However, studying the relationship between lens dislocation and its suspicious risk factors using numerous videos is a time-extensive procedure. Hence, the surgeons demand an automatic approach to enable a larger-scale and, accordingly, more reliable study. In this paper, we propose a novel framework as the major step towards lens irregularity detection. In particular, we propose (I) an end-to-end recurrent neural network to recognize the lens-implantation phase and (II) a novel semantic segmentation network to segment the lens and pupil after the implantation phase. The phase recognition results reveal the effectiveness of the proposed surgical phase recognition approach. Moreover, the segmentation results confirm the proposed segmentation network's effectiveness compared to state-of-the-art rival approaches.

READ FULL TEXT

page 12

page 13

research
07/06/2020

Automatic semantic segmentation for prediction of tuberculosis using lens-free microscopy images

Tuberculosis (TB), caused by a germ called Mycobacterium tuberculosis, i...
research
05/22/2018

Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networks

Real-time algorithms for automatically recognizing surgical phases are n...
research
10/14/2017

GHCLNet: A Generalized Hierarchically tuned Contact Lens detection Network

Iris serves as one of the best biometric modality owing to its complex, ...
research
09/25/2021

ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos

Semantic segmentation in surgical videos is a prerequisite for a broad r...
research
04/29/2021

Relevance Detection in Cataract Surgery Videos by Spatio-Temporal Action Localization

In cataract surgery, the operation is performed with the help of a micro...
research
09/12/2022

Small PSL(2, 𝔽) representations of Seifert fiber space groups

Let M be a Seifert fiber space with non-abelian fundamental group and ad...
research
07/05/2020

Using Capsule Neural Network to predict Tuberculosis in lens-free microscopic images

Tuberculosis, caused by a bacteria called Mycobacterium tuberculosis, is...

Please sign up or login with your details

Forgot password? Click here to reset