Log In Sign Up

Motion-based Camera Localization System in Colonoscopy Videos

by   Heming Yao, et al.

Optical colonoscopy is an essential diagnostic and prognostic tool for many gastrointestinal diseases including cancer screening and staging, intestinal bleeding, diarrhea, abdominal symptom evaluation, and inflammatory bowel disease assessment. However, the evaluation, classification, and quantification of findings on colonoscopy are subject to inter-observer variation. Automated assessment of colonoscopy is of interest considering the subjectivity present in qualitative human interpretations of colonoscopy findings. Localization of the camera is an essential element to consider when inferring the meaning and context of findings for diseases evaluated by colonoscopy. In this study, we proposed a camera localization system to estimate the approximate anatomic location of the camera and classify the anatomical colon segment the camera is in. The camera localization system starts with non-informative frame detection to remove frames without camera motion information. Then a self-training end-to-end convolutional neural network was built to estimate the camera motion. With the estimated camera motion, the camera trajectory can be derived, and the location index can be calculated. Based on the estimated location index, anatomical colon segment classification was performed by building the colon template. The algorithm was trained and validated using colonoscopy videos collected from routine clinical practice. From our results, the average accuracy of the classification is 0.759, which is substantially higher than the performance of using the location index built from other methods.


page 3

page 5

page 7

page 8

page 10

page 11

page 13


Sequential anatomy localization in fetal echocardiography videos

Fetal heart motion is an important diagnostic indicator for structural d...

Siamese Network Features for Endoscopy Image and Video Localization

Conventional Endoscopy (CE) and Wireless Capsule Endoscopy (WCE) are kno...

Video-Based Camera Localization Using Anchor View Detection and Recursive 3D Reconstruction

In this paper we introduce a new camera localization strategy designed f...

Graph Convolution Neural Network For Weakly Supervised Abnormality Localization In Long Capsule Endoscopy Videos

Temporal activity localization in long videos is an important problem. T...

Ego-Downward and Ambient Video based Person Location Association

Using an ego-centric camera to do localization and tracking is highly ne...

Cricket stroke extraction: Towards creation of a large-scale cricket actions dataset

In this paper, we deal with the problem of temporal action localization ...

UNav: An Infrastructure-Independent Vision-Based Navigation System for People with Blindness and Low vision

Vision-based localization approaches now underpin newly emerging navigat...