DeepAI
Log In Sign Up

Motion-based Camera Localization System in Colonoscopy Videos

12/03/2020
by   Heming Yao, et al.
11

Optical colonoscopy is an essential diagnostic and prognostic tool for many gastrointestinal diseases including cancer screening and staging, intestinal bleeding, diarrhea, abdominal symptom evaluation, and inflammatory bowel disease assessment. However, the evaluation, classification, and quantification of findings on colonoscopy are subject to inter-observer variation. Automated assessment of colonoscopy is of interest considering the subjectivity present in qualitative human interpretations of colonoscopy findings. Localization of the camera is an essential element to consider when inferring the meaning and context of findings for diseases evaluated by colonoscopy. In this study, we proposed a camera localization system to estimate the approximate anatomic location of the camera and classify the anatomical colon segment the camera is in. The camera localization system starts with non-informative frame detection to remove frames without camera motion information. Then a self-training end-to-end convolutional neural network was built to estimate the camera motion. With the estimated camera motion, the camera trajectory can be derived, and the location index can be calculated. Based on the estimated location index, anatomical colon segment classification was performed by building the colon template. The algorithm was trained and validated using colonoscopy videos collected from routine clinical practice. From our results, the average accuracy of the classification is 0.759, which is substantially higher than the performance of using the location index built from other methods.

READ FULL TEXT

page 3

page 5

page 7

page 8

page 10

page 11

page 13

10/28/2018

Sequential anatomy localization in fetal echocardiography videos

Fetal heart motion is an important diagnostic indicator for structural d...
03/15/2021

Siamese Network Features for Endoscopy Image and Video Localization

Conventional Endoscopy (CE) and Wireless Capsule Endoscopy (WCE) are kno...
07/07/2021

Video-Based Camera Localization Using Anchor View Detection and Recursive 3D Reconstruction

In this paper we introduce a new camera localization strategy designed f...
10/18/2021

Graph Convolution Neural Network For Weakly Supervised Abnormality Localization In Long Capsule Endoscopy Videos

Temporal activity localization in long videos is an important problem. T...
12/02/2018

Ego-Downward and Ambient Video based Person Location Association

Using an ego-centric camera to do localization and tracking is highly ne...
01/10/2019

Cricket stroke extraction: Towards creation of a large-scale cricket actions dataset

In this paper, we deal with the problem of temporal action localization ...
09/22/2022

UNav: An Infrastructure-Independent Vision-Based Navigation System for People with Blindness and Low vision

Vision-based localization approaches now underpin newly emerging navigat...