DeepAI AI Chat
Log In Sign Up

Heatmap-based 2D Landmark Detection with a Varying Number of Landmarks

by   Antonia Stern, et al.

Mitral valve repair is a surgery to restore the function of the mitral valve. To achieve this, a prosthetic ring is sewed onto the mitral annulus. Analyzing the sutures, which are punctured through the annulus for ring implantation, can be useful in surgical skill assessment, for quantitative surgery and for positioning a virtual prosthetic ring model in the scene via augmented reality. This work presents a neural network approach which detects the sutures in endoscopic images of mitral valve repair and therefore solves a landmark detection problem with varying amount of landmarks, as opposed to most other existing deep learning-based landmark detection approaches. The neural network is trained separately on two data collections from different domains with the same architecture and hyperparameter settings. The datasets consist of more than 1,300 stereo frame pairs each, with a total over 60,000 annotated landmarks. The proposed heatmap-based neural network achieves a mean positive predictive value (PPV) of 66.68±4.67 of 24.45±5.06 81.50±5.77% and a mean TPR of 61.60±6.11 surgical simulation. The best detection results are achieved when the camera is positioned above the mitral valve with good illumination. A detection from a sideward view is also possible if the mitral valve is well perceptible.


3D landmark detection for augmented reality based otologic procedures

Ear consists of the smallest bones in the human body and does not contai...

Improved Heatmap-based Landmark Detection

Mitral valve repair is a very difficult operation, often requiring exper...

Virtual Dress Swap Using Landmark Detection

Online shopping has gained popularity recently. This paper addresses one...

Point detection through multi-instance deep heatmap regression for sutures in endoscopy

Purpose: Mitral valve repair is a complex minimally invasive surgery of ...

Automatic Tool Landmark Detection for Stereo Vision in Robot-Assisted Retinal Surgery

Computer vision and robotics are being increasingly applied in medical i...

Large Scale Landmark Recognition via Deep Metric Learning

This paper presents a novel approach for landmark recognition in images ...