Temporal coherence-based self-supervised learning for laparoscopic workflow analysis

06/18/2018
by   Isabel Funke, et al.
0

In order to provide the right type of assistance at the right time, computer-assisted surgery systems need context awareness. To achieve this, methods for surgical workflow analysis are crucial. Currently, convolutional neural networks provide the best performance for video-based workflow analysis tasks. For training such networks, large amounts of annotated data are necessary. However, annotating surgical data requires expert knowledge, which is why collecting a sufficient amount of data is often difficult, time-consuming and not always feasible. In this paper, we address this problem by presenting and comparing different approaches for self-supervised pretraining of neural networks on unlabeled laparoscopic videos using temporal coherence. We evaluate our pretrained networks on Cholec80, a publicly available dataset for surgical phase segmentation, on which a maximum F1 score of 84.6 was reached. Furthermore, we were able to achieve an increase of the F1 score of up to 10 when compared to a non-pretrained neural network.

READ FULL TEXT
11/08/2018

Active Learning using Deep Bayesian Networks for Surgical Workflow Analysis

For many applications in the field of computer assisted surgery, such as...
07/16/2022

Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis

Data-driven approaches to assist operating room (OR) workflow analysis d...
05/19/2022

Free Lunch for Surgical Video Understanding by Distilling Self-Supervisions

Self-supervised learning has witnessed great progress in vision and NLP;...
09/30/2021

Workflow Augmentation of Video Data for Event Recognition with Time-Sensitive Neural Networks

Supervised training of neural networks requires large, diverse and well ...
04/21/2020

LRTD: Long-Range Temporal Dependency based Active Learning for Surgical Workflow Recognition

Automatic surgical workflow recognition in video is an essentially funda...
03/15/2022

On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis

Batch Normalization's (BN) unique property of depending on other samples...
10/28/2016

The TUM LapChole dataset for the M2CAI 2016 workflow challenge

In this technical report we present our collected dataset of laparoscopi...