Robust Medical Instrument Segmentation Challenge 2019

by   Tobias Ross, et al.

Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions. While numerous methods for detecting, segmenting and tracking of medical instruments based on endoscopic video images have been proposed in the literature, key limitations remain to be addressed: Firstly, robustness, that is, the reliable performance of state-of-the-art methods when run on challenging images (e.g. in the presence of blood, smoke or motion artifacts). Secondly, generalization; algorithms trained for a specific intervention in a specific hospital should generalize to other interventions or institutions. In an effort to promote solutions for these limitations, we organized the Robust Medical Instrument Segmentation (ROBUST-MIS) challenge as an international benchmarking competition with a specific focus on the robustness and generalization capabilities of algorithms. For the first time in the field of endoscopic image processing, our challenge included a task on binary segmentation and also addressed multi-instance detection and segmentation. The challenge was based on a surgical data set comprising 10,040 annotated images acquired from a total of 30 surgical procedures from three different types of surgery. The validation of the competing methods for the three tasks (binary segmentation, multi-instance detection and multi-instance segmentation) was performed in three different stages with an increasing domain gap between the training and the test data. The results confirm the initial hypothesis, namely that algorithm performance degrades with an increasing domain gap. While the average detection and segmentation quality of the best-performing algorithms is high, future research should concentrate on detection and segmentation of small, crossing, moving and transparent instrument(s) (parts).


page 5

page 14

page 17

page 25

page 31

page 32

page 33

page 34


Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Room

Image-based tracking of medical instruments is an integral part of many ...

Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedures

Image-based tracking of laparoscopic instruments plays a fundamental rol...

How can we learn (more) from challenges? A statistical approach to driving future algorithm development.

Challenges have become the state-of-the-art approach to benchmark image...

Segmenting Medical Instruments in Minimally Invasive Surgeries using AttentionMask

Precisely locating and segmenting medical instruments in images of minim...

2017 Robotic Instrument Segmentation Challenge

In mainstream computer vision and machine learning, public datasets such...

Segmentation of Surgical Instruments for Minimally-Invasive Robot-Assisted Procedures Using Generative Deep Neural Networks

This work proves that semantic segmentation on minimally invasive surgic...

VOIDD: automatic vessel of intervention dynamic detection in PCI procedures

In this article, we present the work towards improving the overall workf...

Code Repositories


Scripts for the robust medical instrument segmentation challenge 2019

view repo