Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network

11/08/2021
by   Jiacheng Wang, et al.
11

We propose a novel shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection (ESD) surgery. This task is of great clinical significance but extremely challenging due to bleeding, lighting reflection, and motion blur in the complicated surgical environment. Compared with existing solutions, which either neglect geometric relationships among targeting objects or capture the relationships by using complicated aggregation schemes, the proposed network is capable of achieving satisfactory accuracy while maintaining real-time performance by taking full advantage of the spatial relations among landmarks. We first devise an algorithm to automatically generate relation keypoint heatmaps, which are able to intuitively represent the prior knowledge of spatial relations among landmarks without using any extra manual annotation efforts. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process. While one scheme introduces pixel-level regularization by multi-task learning, the other integrates global-level regularization by harnessing a newly designed grouped consistency evaluator, which adds relation constraints to the proposed network in an adversarial manner. Both schemes are beneficial to the model in training, and can be readily unloaded in inference to achieve real-time detection. We establish a large in-house dataset of ESD surgery for esophageal cancer to validate the effectiveness of our proposed method. Extensive experimental results demonstrate that our approach outperforms state-of-the-art methods in terms of accuracy and efficiency, achieving better detection results faster. Promising results on two downstream applications further corroborate the great potential of our method in ESD clinical practice.

READ FULL TEXT

page 1

page 2

page 5

page 9

page 10

page 11

research
09/02/2019

Combining Deep Learning and Model-Based Methods for Robust Real-Time Semantic Landmark Detection

Compared to abstract features, significant objects, so-called landmarks,...
research
08/28/2019

A Global-Local Emebdding Module for Fashion Landmark Detection

Detecting fashion landmarks is a fundamental technique for visual clothi...
research
09/19/2023

LineMarkNet: Line Landmark Detection for Valet Parking

We aim for accurate and efficient line landmark detection for valet park...
research
12/23/2021

Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network

Current fully-supervised facial landmark detection methods have progress...
research
05/18/2023

Coordinated Transformer with Position & Sample-aware Central Loss for Anatomical Landmark Detection

Heatmap-based anatomical landmark detection is still facing two unresolv...
research
03/01/2022

JOINED : Prior Guided Multi-task Learning for Joint Optic Disc/Cup Segmentation and Fovea Detection

Fundus photography has been routinely used to document the presence and ...

Please sign up or login with your details

Forgot password? Click here to reset