Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract

05/10/2019
by   Sharib Ali, et al.
0

Endoscopy is a routine imaging technique used for both diagnosis and minimally invasive surgical treatment. While the endoscopy video contains a wealth of information, tools to capture this information for the purpose of clinical reporting are rather poor. In date, endoscopists do not have any access to tools that enable them to browse the video data in an efficient and user friendly manner. Fast and reliable video retrieval methods could for example, allow them to review data from previous exams and therefore improve their ability to monitor disease progression. Deep learning provides new avenues of compressing and indexing video in an extremely efficient manner. In this study, we propose to use an autoencoder for efficient video compression and fast retrieval of video images. To boost the accuracy of video image retrieval and to address data variability like multi-modality and view-point changes, we propose the integration of a Siamese network. We demonstrate that our approach is competitive in retrieving images from 3 large scale videos of 3 different patients obtained against the query samples of their previous diagnosis. Quantitative validation shows that the combined approach yield an overall improvement of 5 respectively.

READ FULL TEXT
research
11/20/2012

Content based video retrieval

Content based video retrieval is an approach for facilitating the search...
research
01/13/2021

Advancing Eosinophilic Esophagitis Diagnosis and Phenotype Assessment with Deep Learning Computer Vision

Eosinophilic Esophagitis (EoE) is an inflammatory esophageal disease whi...
research
11/04/2020

Graph Based Temporal Aggregation for Video Retrieval

Large scale video retrieval is a field of study with a lot of ongoing re...
research
07/21/2017

Date-Field Retrieval in Scene Image and Video Frames using Text Enhancement and Shape Coding

Text recognition in scene image and video frames is difficult because of...
research
10/14/2018

CNN-VWII: An Efficient Approach for Large-Scale Video Retrieval by Image Queries

This paper aims to solve the problem of large-scale video retrieval by a...
research
03/08/2022

Live Laparoscopic Video Retrieval with Compressed Uncertainty

Searching through large volumes of medical data to retrieve relevant inf...
research
08/14/2013

An interactive engine for multilingual video browsing using semantic content

The amount of audio-visual information has increased dramatically with t...

Please sign up or login with your details

Forgot password? Click here to reset