Deep Attention Based Semi-Supervised 2D-Pose Estimation for Surgical Instruments

12/10/2019
by   Mert Kayhan, et al.
10

For many practical problems and applications, it is not feasible to create a vast and accurately labeled dataset, which restricts the application of deep learning in many areas. Semi-supervised learning algorithms intend to improve performance by also leveraging unlabeled data. This is very valuable for 2D-pose estimation task where data labeling requires substantial time and is subject to noise. This work aims to investigate if semi-supervised learning techniques can achieve acceptable performance level that makes using these algorithms during training justifiable. To this end, a lightweight network architecture is introduced and mean teacher, virtual adversarial training and pseudo-labeling algorithms are evaluated on 2D-pose estimation for surgical instruments. For the applicability of pseudo-labelling algorithm, we propose a novel confidence measure, total variation. Experimental results show that utilization of semi-supervised learning improves the performance on unseen geometries drastically while maintaining high accuracy for seen geometries. For RMIT benchmark, our lightweight architecture outperforms state-of-the-art with supervised learning. For Endovis benchmark, pseudo-labelling algorithm improves the supervised baseline achieving the new state-of-the-art performance.

READ FULL TEXT

page 3

page 4

page 5

page 8

research
10/12/2021

Couple Learning: Mean Teacher method with pseudo-labels improves semi-supervised deep learning results

The recently proposed Mean Teacher has achieved state-of-the-art results...
research
04/14/2022

SemiMultiPose: A Semi-supervised Multi-animal Pose Estimation Framework

Multi-animal pose estimation is essential for studying animals' social b...
research
05/17/2023

Confidence-Guided Semi-supervised Learning in Land Cover Classification

Semi-supervised learning has been well developed to help reduce the cost...
research
08/09/2023

SegMatch: A semi-supervised learning method for surgical instrument segmentation

Surgical instrument segmentation is recognised as a key enabler to provi...
research
03/15/2022

Pose-MUM : Reinforcing Key Points Relationship for Semi-Supervised Human Pose Estimation

A well-designed strong-weak augmentation strategy and the stable teacher...
research
11/25/2020

Humble Teacher and Eager Student: Dual Network Learning for Semi-supervised 2D Human Pose Estimation

Semi-supervised learning aims to boost the accuracy of a model by explor...
research
07/23/2022

Combining Hybrid Architecture and Pseudo-label for Semi-supervised Abdominal Organ Segmentation

Abdominal organ segmentation has many important clinical applications, s...

Please sign up or login with your details

Forgot password? Click here to reset