Self-Supervised Endoscopic Image Key-Points Matching

08/24/2022
by   Manel Farhat, et al.
2

Feature matching and finding correspondences between endoscopic images is a key step in many clinical applications such as patient follow-up and generation of panoramic image from clinical sequences for fast anomalies localization. Nonetheless, due to the high texture variability present in endoscopic images, the development of robust and accurate feature matching becomes a challenging task. Recently, deep learning techniques which deliver learned features extracted via convolutional neural networks (CNNs) have gained traction in a wide range of computer vision tasks. However, they all follow a supervised learning scheme where a large amount of annotated data is required to reach good performances, which is generally not always available for medical data databases. To overcome this limitation related to labeled data scarcity, the self-supervised learning paradigm has recently shown great success in a number of applications. This paper proposes a novel self-supervised approach for endoscopic image matching based on deep learning techniques. When compared to standard hand-crafted local feature descriptors, our method outperformed them in terms of precision and recall. Furthermore, our self-supervised descriptor provides a competitive performance in comparison to a selection of state-of-the-art deep learning based supervised methods in terms of precision and matching score.

READ FULL TEXT

page 11

page 12

page 14

page 21

page 24

research
06/19/2023

Graph Self-Supervised Learning for Endoscopic Image Matching

Accurate feature matching and correspondence in endoscopic images play a...
research
03/08/2022

SuperPoint features in endoscopy

There is often a significant gap between research results and applicabil...
research
12/18/2020

Self-supervised Learning with Fully Convolutional Networks

Although deep learning based methods have achieved great success in many...
research
07/31/2020

Uncovering the structure of clinical EEG signals with self-supervised learning

Objective. Supervised learning paradigms are often limited by the amount...
research
05/10/2019

Neural-Guided RANSAC: Learning Where to Sample Model Hypotheses

We present Neural-Guided RANSAC (NG-RANSAC), an extension to the classic...
research
05/06/2022

IMU Based Deep Stride Length Estimation With Self-Supervised Learning

Stride length estimation using inertial measurement unit (IMU) sensors i...

Please sign up or login with your details

Forgot password? Click here to reset